Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 943071 Details for
Bug 1148470
cannot run a VM on rhel6.6 host
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine log
engine.log (text/plain), 4.13 MB, created by
Petr Beňas
on 2014-10-01 14:24:54 UTC
(
hide
)
Description:
engine log
Filename:
MIME Type:
Creator:
Petr Beňas
Created:
2014-10-01 14:24:54 UTC
Size:
4.13 MB
patch
obsolete
>2014-08-23 03:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [34fec41a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:17:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [34fec41a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 14c418e3 >2014-08-23 03:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [34fec41a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [34fec41a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [34fec41a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [1a674ed4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:17 AM >2014-08-23 03:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [399c38e5] Autorecovering 1 storage domains >2014-08-23 03:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [399c38e5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1627ed1f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1627ed1f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:20 AM >2014-08-23 03:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [792e0789] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [792e0789] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68b47ed >2014-08-23 03:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [792e0789] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [792e0789] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68b47ed >2014-08-23 03:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [792e0789] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [792e0789] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [792e0789] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:22:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1627ed1f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:22 AM >2014-08-23 03:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [2ef43464] Autorecovering 1 storage domains >2014-08-23 03:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [2ef43464] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [5cf1203d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [5cf1203d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:25 AM >2014-08-23 03:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [d862eb8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [d862eb8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21f5cb03 >2014-08-23 03:27:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [d862eb8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:27:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [d862eb8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 21f5cb03 >2014-08-23 03:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [d862eb8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:27:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [d862eb8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:27:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [d862eb8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [5cf1203d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:27 AM >2014-08-23 03:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [4b30eeeb] Autorecovering 1 storage domains >2014-08-23 03:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [4b30eeeb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [41549a97] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [41549a97] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:30 AM >2014-08-23 03:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [1247b989] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [1247b989] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f035acc >2014-08-23 03:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [1247b989] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [1247b989] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7f035acc >2014-08-23 03:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [1247b989] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [1247b989] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [1247b989] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [41549a97] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:32 AM >2014-08-23 03:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [388650b5] Autorecovering 1 storage domains >2014-08-23 03:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [388650b5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [26d93c9f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [26d93c9f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:35 AM >2014-08-23 03:35:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69a1f4fd >2014-08-23 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-77) [5cf1203d] Start deleteAgedOutAuditLogs >2014-08-23 03:35:35,008 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-77) [5cf1203d] Finished deleteAgedOutAuditLogs >2014-08-23 03:36:29,165 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 03:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:37:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69a1f4fd >2014-08-23 03:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [11b7a9f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:37:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [26d93c9f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:37 AM >2014-08-23 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [3b8ad80f] Autorecovering 1 storage domains >2014-08-23 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [3b8ad80f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [6e59dc86] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [6e59dc86] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:40 AM >2014-08-23 03:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 39b723e8 >2014-08-23 03:40:22,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Attempting to update VMs/Templates Ovf. >2014-08-23 03:40:22,550 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Attempting to update VM OVFs in Data Center Default >2014-08-23 03:40:22,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Successfully updated VM OVFs in Data Center Default >2014-08-23 03:40:22,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Attempting to update template OVFs in Data Center Default >2014-08-23 03:40:22,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Successfully updated templates OVFs in Data Center Default >2014-08-23 03:40:22,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 03:40:22,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [609fb656] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 03:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:42:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 39b723e8 >2014-08-23 03:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:42:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [1f06ad2f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:42:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [6e59dc86] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:42 AM >2014-08-23 03:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [6cfb954a] Autorecovering 1 storage domains >2014-08-23 03:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [6cfb954a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [34c33350] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [34c33350] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:45 AM >2014-08-23 03:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [443b3b7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [443b3b7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1425b36f >2014-08-23 03:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [443b3b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:47:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [443b3b7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1425b36f >2014-08-23 03:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [443b3b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:47:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [443b3b7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [443b3b7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:47:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [34c33350] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:47 AM >2014-08-23 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [189dea95] Autorecovering 1 storage domains >2014-08-23 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [189dea95] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [757ffd7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [757ffd7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:50 AM >2014-08-23 03:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [31523e72] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [31523e72] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2c800d42 >2014-08-23 03:52:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [31523e72] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:52:05,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [31523e72] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2c800d42 >2014-08-23 03:52:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [31523e72] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:52:05,143 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [31523e72] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:52:05,147 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [31523e72] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:52:05,147 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [757ffd7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:52 AM >2014-08-23 03:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [6ab6e636] Autorecovering 1 storage domains >2014-08-23 03:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [6ab6e636] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [62e618e1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [62e618e1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:55 AM >2014-08-23 03:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4980e329] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 03:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4980e329] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bd7af37 >2014-08-23 03:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4980e329] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 03:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4980e329] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7bd7af37 >2014-08-23 03:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4980e329] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 03:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [4980e329] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 03:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4980e329] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 03:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [62e618e1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:57 AM >2014-08-23 04:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [1627ed1f] Autorecovering 1 storage domains >2014-08-23 04:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [1627ed1f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1e3232ca] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1e3232ca] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:00 AM >2014-08-23 04:00:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:00:00,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f4e2b97 >2014-08-23 04:02:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:02:05,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3f4e2b97 >2014-08-23 04:02:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:02:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:02:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [3b7f8160] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:02:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [1e3232ca] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:02 AM >2014-08-23 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [5cf1203d] Autorecovering 1 storage domains >2014-08-23 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [5cf1203d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [129485dd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [129485dd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:05 AM >2014-08-23 04:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1efde4 >2014-08-23 04:07:05,169 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:07:05,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1efde4 >2014-08-23 04:07:05,170 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:07:05,171 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:07:05,175 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [1cbbe14b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:07:05,175 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [129485dd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:07 AM >2014-08-23 04:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [4c4d0644] Autorecovering 1 storage domains >2014-08-23 04:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [4c4d0644] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [d7497ed] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [d7497ed] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:10 AM >2014-08-23 04:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [6cb91615] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [6cb91615] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: cb7c81f >2014-08-23 04:12:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [6cb91615] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:12:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [6cb91615] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: cb7c81f >2014-08-23 04:12:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [6cb91615] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:12:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [6cb91615] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:12:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [6cb91615] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:12:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [d7497ed] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:12 AM >2014-08-23 04:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [4a0567ad] Autorecovering 1 storage domains >2014-08-23 04:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [4a0567ad] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [2842e27b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [2842e27b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:15 AM >2014-08-23 04:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [ea42b40] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [ea42b40] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19559d50 >2014-08-23 04:17:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [ea42b40] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:17:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [ea42b40] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 19559d50 >2014-08-23 04:17:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [ea42b40] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:17:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [ea42b40] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [ea42b40] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:17:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [2842e27b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:17 AM >2014-08-23 04:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [56db4dba] Autorecovering 1 storage domains >2014-08-23 04:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [56db4dba] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [164e5369] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [164e5369] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:20 AM >2014-08-23 04:20:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [e6114a3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:20:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [e6114a3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79e92883 >2014-08-23 04:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [e6114a3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:22:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [e6114a3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79e92883 >2014-08-23 04:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [e6114a3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [e6114a3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:22:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [e6114a3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:22:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [164e5369] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:22 AM >2014-08-23 04:23:42,278 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 04:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [62e618e1] Autorecovering 1 storage domains >2014-08-23 04:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [62e618e1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [345d8c94] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [345d8c94] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:25 AM >2014-08-23 04:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1cff1c9f >2014-08-23 04:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1cff1c9f >2014-08-23 04:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [3c52d4e9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:27:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [345d8c94] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:27 AM >2014-08-23 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [2e4d00ec] Autorecovering 1 storage domains >2014-08-23 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [2e4d00ec] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [6f7cce3d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [6f7cce3d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:30 AM >2014-08-23 04:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [498e7efc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [498e7efc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c8ee56f >2014-08-23 04:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [498e7efc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:32:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [498e7efc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1c8ee56f >2014-08-23 04:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [498e7efc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [498e7efc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [498e7efc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [6f7cce3d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:32 AM >2014-08-23 04:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [6797bb58] Autorecovering 1 storage domains >2014-08-23 04:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [6797bb58] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1a82ca66] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1a82ca66] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:35 AM >2014-08-23 04:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [ad77243] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [ad77243] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 34af95be >2014-08-23 04:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [ad77243] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:37:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [ad77243] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 34af95be >2014-08-23 04:37:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [ad77243] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:37:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [ad77243] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:37:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [ad77243] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:37:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1a82ca66] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:37 AM >2014-08-23 04:40:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [41893c40] Autorecovering 1 storage domains >2014-08-23 04:40:00,027 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [41893c40] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:40:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6e66129a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:40:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6e66129a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:40 AM >2014-08-23 04:40:00,036 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:40:00,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: ff1e74d >2014-08-23 04:40:22,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Attempting to update VMs/Templates Ovf. >2014-08-23 04:40:22,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Attempting to update VM OVFs in Data Center Default >2014-08-23 04:40:22,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Successfully updated VM OVFs in Data Center Default >2014-08-23 04:40:22,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Attempting to update template OVFs in Data Center Default >2014-08-23 04:40:22,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Successfully updated templates OVFs in Data Center Default >2014-08-23 04:40:22,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 04:40:22,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) [55451e14] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 04:42:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:42:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: ff1e74d >2014-08-23 04:42:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:42:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:42:05,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [6ecfcdc8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:42:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6e66129a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:42 AM >2014-08-23 04:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [5543c48f] Autorecovering 1 storage domains >2014-08-23 04:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [5543c48f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [2fc552bf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:45 AM >2014-08-23 04:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a7f2272 >2014-08-23 04:47:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:47:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3a7f2272 >2014-08-23 04:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:47:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [4ccfd344] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:47:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [2fc552bf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:47 AM >2014-08-23 04:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [386f802e] Autorecovering 1 storage domains >2014-08-23 04:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [386f802e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cd4a7d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cd4a7d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:50 AM >2014-08-23 04:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [64e805e5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [64e805e5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44a125e8 >2014-08-23 04:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [64e805e5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [64e805e5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 44a125e8 >2014-08-23 04:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [64e805e5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:52:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [64e805e5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [64e805e5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cd4a7d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:52 AM >2014-08-23 04:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [52b719d5] Autorecovering 1 storage domains >2014-08-23 04:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [52b719d5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 04:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [43e053d2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 04:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [43e053d2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:55 AM >2014-08-23 04:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [443bb15] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 04:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [443bb15] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a6ba717 >2014-08-23 04:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [443bb15] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 04:57:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [443bb15] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7a6ba717 >2014-08-23 04:57:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [443bb15] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 04:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [443bb15] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 04:57:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [443bb15] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 04:57:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [43e053d2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:57 AM >2014-08-23 05:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [157bc7ec] Autorecovering 1 storage domains >2014-08-23 05:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [157bc7ec] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [7ab4a59a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [7ab4a59a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:00 AM >2014-08-23 05:00:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [21583664] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:00:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [21583664] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 894eb40 >2014-08-23 05:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [21583664] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:02:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [21583664] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 894eb40 >2014-08-23 05:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [21583664] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:02:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [21583664] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [21583664] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:02:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [7ab4a59a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:02 AM >2014-08-23 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [64391bdc] Autorecovering 1 storage domains >2014-08-23 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [64391bdc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [bca9447] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [bca9447] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:05 AM >2014-08-23 05:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e151c89 >2014-08-23 05:07:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:07:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2e151c89 >2014-08-23 05:07:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:07:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:07:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [7ecd6a83] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:07:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [bca9447] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:07 AM >2014-08-23 05:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [5078e6f2] Autorecovering 1 storage domains >2014-08-23 05:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [5078e6f2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [ceb8fc6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [ceb8fc6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:10 AM >2014-08-23 05:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [6299045d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [6299045d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3227487a >2014-08-23 05:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [6299045d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:12:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [6299045d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3227487a >2014-08-23 05:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [6299045d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [6299045d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [6299045d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [ceb8fc6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:12 AM >2014-08-23 05:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [16c74cfb] Autorecovering 1 storage domains >2014-08-23 05:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [16c74cfb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [196e6486] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [196e6486] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:15 AM >2014-08-23 05:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [41404e6b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [41404e6b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2bf4d129 >2014-08-23 05:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [41404e6b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [41404e6b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2bf4d129 >2014-08-23 05:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [41404e6b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [41404e6b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [41404e6b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [196e6486] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:17 AM >2014-08-23 05:17:59,897 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 05:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4cd4a7d] Autorecovering 1 storage domains >2014-08-23 05:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4cd4a7d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4c224062] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4c224062] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:20 AM >2014-08-23 05:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21ad32a4 >2014-08-23 05:22:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:22:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 21ad32a4 >2014-08-23 05:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:22:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [421fd2d4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:22:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4c224062] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:22 AM >2014-08-23 05:24:18,825 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 05:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [1e65f413] Autorecovering 1 storage domains >2014-08-23 05:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [1e65f413] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [3e7876e4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [3e7876e4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:25 AM >2014-08-23 05:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 451ae60f >2014-08-23 05:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 451ae60f >2014-08-23 05:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [6efa3bb8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:27:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [3e7876e4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:27 AM >2014-08-23 05:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [d2ac069] Autorecovering 1 storage domains >2014-08-23 05:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [d2ac069] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [5688a9e6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [5688a9e6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:30 AM >2014-08-23 05:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2b252e50] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2b252e50] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 31493751 >2014-08-23 05:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2b252e50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:32:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2b252e50] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 31493751 >2014-08-23 05:32:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2b252e50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [2b252e50] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:32:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2b252e50] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:32:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [5688a9e6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:32 AM >2014-08-23 05:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [43e053d2] Autorecovering 1 storage domains >2014-08-23 05:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [43e053d2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [5cbd46e5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [5cbd46e5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:35 AM >2014-08-23 05:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1b49dfd >2014-08-23 05:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:37:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1b49dfd >2014-08-23 05:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:37:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:37:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [66c00ce7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:37:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [5cbd46e5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:37 AM >2014-08-23 05:39:12,823 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 05:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [31c5cf44] Autorecovering 1 storage domains >2014-08-23 05:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [31c5cf44] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [5530fb9e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [5530fb9e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:40 AM >2014-08-23 05:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4853b73b >2014-08-23 05:40:22,560 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update VMs/Templates Ovf. >2014-08-23 05:40:22,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update VM OVFs in Data Center Default >2014-08-23 05:40:22,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully updated VM OVFs in Data Center Default >2014-08-23 05:40:22,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update template OVFs in Data Center Default >2014-08-23 05:40:22,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully updated templates OVFs in Data Center Default >2014-08-23 05:40:22,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 05:40:22,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 05:42:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:42:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4853b73b >2014-08-23 05:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:42:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [23ab38b6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [5530fb9e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:42 AM >2014-08-23 05:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7cb834a4] Autorecovering 1 storage domains >2014-08-23 05:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7cb834a4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [12787e47] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [12787e47] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:45 AM >2014-08-23 05:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [67ea439f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [67ea439f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2018d053 >2014-08-23 05:47:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [67ea439f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:47:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [67ea439f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2018d053 >2014-08-23 05:47:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [67ea439f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [67ea439f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:47:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [67ea439f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:47:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [12787e47] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:47 AM >2014-08-23 05:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [7c430af] Autorecovering 1 storage domains >2014-08-23 05:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [7c430af] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [324b7fe4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [324b7fe4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:50 AM >2014-08-23 05:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [57e710bd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [57e710bd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 674f8058 >2014-08-23 05:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [57e710bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [57e710bd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 674f8058 >2014-08-23 05:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [57e710bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:52:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [57e710bd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [57e710bd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [324b7fe4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:52 AM >2014-08-23 05:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [92b888] Autorecovering 1 storage domains >2014-08-23 05:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [92b888] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 05:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [26794939] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 05:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [26794939] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:55 AM >2014-08-23 05:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [65277781] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 05:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [65277781] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e0d281f >2014-08-23 05:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [65277781] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 05:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [65277781] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6e0d281f >2014-08-23 05:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [65277781] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 05:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [65277781] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 05:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [65277781] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 05:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [26794939] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:57 AM >2014-08-23 06:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [4b963103] Autorecovering 1 storage domains >2014-08-23 06:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [4b963103] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [4afe65e3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [4afe65e3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:00 AM >2014-08-23 06:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [2611e238] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2611e238] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ecb320a >2014-08-23 06:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [2611e238] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:02:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2611e238] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5ecb320a >2014-08-23 06:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [2611e238] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:02:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [2611e238] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [2611e238] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:02:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [4afe65e3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:02 AM >2014-08-23 06:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [78776059] Autorecovering 1 storage domains >2014-08-23 06:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [78776059] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [47d6ff53] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [47d6ff53] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:05 AM >2014-08-23 06:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [4260bf73] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4260bf73] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 325c9b4e >2014-08-23 06:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [4260bf73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:07:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4260bf73] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 325c9b4e >2014-08-23 06:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [4260bf73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [4260bf73] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:07:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [4260bf73] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:07:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [47d6ff53] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:07 AM >2014-08-23 06:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [5530fb9e] Autorecovering 1 storage domains >2014-08-23 06:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [5530fb9e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4f7c14ed] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4f7c14ed] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:10 AM >2014-08-23 06:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:10:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6276356d >2014-08-23 06:12:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:12:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6276356d >2014-08-23 06:12:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:12:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:12:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2f79a89c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:12:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4f7c14ed] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:12 AM >2014-08-23 06:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [5cbd46e5] Autorecovering 1 storage domains >2014-08-23 06:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [5cbd46e5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [c4ec87b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [c4ec87b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:15 AM >2014-08-23 06:15:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [12177a50] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:15:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [12177a50] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2b4ecc87 >2014-08-23 06:17:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [12177a50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:17:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [12177a50] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2b4ecc87 >2014-08-23 06:17:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [12177a50] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:17:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [12177a50] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:17:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [12177a50] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:17:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [c4ec87b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:17 AM >2014-08-23 06:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [4f095488] Autorecovering 1 storage domains >2014-08-23 06:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [4f095488] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [36819a69] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [36819a69] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:20 AM >2014-08-23 06:20:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:20:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69754d6 >2014-08-23 06:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:22:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69754d6 >2014-08-23 06:22:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:22:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2b2bc95b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:22:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [36819a69] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:22 AM >2014-08-23 06:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [14a7bbdf] Autorecovering 1 storage domains >2014-08-23 06:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [14a7bbdf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [56e5de2e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [56e5de2e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:25 AM >2014-08-23 06:25:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 58a0afc7 >2014-08-23 06:27:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:27:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 58a0afc7 >2014-08-23 06:27:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:27:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [3a4048c1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:27:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [56e5de2e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:27 AM >2014-08-23 06:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1a82ca66] Autorecovering 1 storage domains >2014-08-23 06:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1a82ca66] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [5cd89135] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [5cd89135] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:30 AM >2014-08-23 06:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [cfe0a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [cfe0a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18231315 >2014-08-23 06:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [cfe0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:32:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [cfe0a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 18231315 >2014-08-23 06:32:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [cfe0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [cfe0a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:32:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [cfe0a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:32:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [5cd89135] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:32 AM >2014-08-23 06:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [5b516096] Autorecovering 1 storage domains >2014-08-23 06:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [5b516096] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [42df1ef2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [42df1ef2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:35 AM >2014-08-23 06:35:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:35:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e684955 >2014-08-23 06:37:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:37:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e684955 >2014-08-23 06:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:37:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6bad55c5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:37:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [42df1ef2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:37 AM >2014-08-23 06:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [757ffd7] Autorecovering 1 storage domains >2014-08-23 06:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [757ffd7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [12edb475] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [12edb475] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:40 AM >2014-08-23 06:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3febfe5f >2014-08-23 06:40:22,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Attempting to update VMs/Templates Ovf. >2014-08-23 06:40:22,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Attempting to update VM OVFs in Data Center Default >2014-08-23 06:40:22,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Successfully updated VM OVFs in Data Center Default >2014-08-23 06:40:22,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Attempting to update template OVFs in Data Center Default >2014-08-23 06:40:22,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Successfully updated templates OVFs in Data Center Default >2014-08-23 06:40:22,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 06:40:22,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 06:42:05,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:42:05,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3febfe5f >2014-08-23 06:42:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:42:05,142 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:42:05,147 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [20ea86e0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:42:05,147 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [12edb475] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:42 AM >2014-08-23 06:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [684b50f0] Autorecovering 1 storage domains >2014-08-23 06:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [684b50f0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2abfb3cd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2abfb3cd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:45 AM >2014-08-23 06:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [3279947c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [3279947c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1823cc2 >2014-08-23 06:47:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [3279947c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:47:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [3279947c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1823cc2 >2014-08-23 06:47:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [3279947c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:47:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [3279947c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:47:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [3279947c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:47:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2abfb3cd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:47 AM >2014-08-23 06:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [28cf5803] Autorecovering 1 storage domains >2014-08-23 06:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [28cf5803] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [7c164c87] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [7c164c87] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:50 AM >2014-08-23 06:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [7bb0963] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [7bb0963] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3cc1e6f1 >2014-08-23 06:52:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [7bb0963] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:52:05,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [7bb0963] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3cc1e6f1 >2014-08-23 06:52:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [7bb0963] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:52:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [7bb0963] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:52:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [7bb0963] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:52:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [7c164c87] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:52 AM >2014-08-23 06:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [2713e184] Autorecovering 1 storage domains >2014-08-23 06:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [2713e184] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 06:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [10aa4590] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 06:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [10aa4590] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:55 AM >2014-08-23 06:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 06:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50d90641 >2014-08-23 06:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 06:57:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 50d90641 >2014-08-23 06:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 06:57:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 06:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [92b4a7c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 06:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [10aa4590] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:57 AM >2014-08-23 07:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [b32d9bf] Autorecovering 1 storage domains >2014-08-23 07:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [b32d9bf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [3c0f91a7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [3c0f91a7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:00 AM >2014-08-23 07:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 51de7045 >2014-08-23 07:02:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:02:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 51de7045 >2014-08-23 07:02:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:02:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:02:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [3254f5f6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:02:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [3c0f91a7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:02 AM >2014-08-23 07:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [2d31e6f7] Autorecovering 1 storage domains >2014-08-23 07:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [2d31e6f7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [3caeaef] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [3caeaef] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:05 AM >2014-08-23 07:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2977153d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2977153d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 96bc24b >2014-08-23 07:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [2977153d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:07:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2977153d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 96bc24b >2014-08-23 07:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [2977153d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:07:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-27) [2977153d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2977153d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [3caeaef] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:07 AM >2014-08-23 07:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [cc48f04] Autorecovering 1 storage domains >2014-08-23 07:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [cc48f04] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3456af35] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3456af35] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:10 AM >2014-08-23 07:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74d13cc8 >2014-08-23 07:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 74d13cc8 >2014-08-23 07:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7b7862a4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3456af35] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:12 AM >2014-08-23 07:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [42df1ef2] Autorecovering 1 storage domains >2014-08-23 07:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [42df1ef2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:15:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [70fcfdf1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:15:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [70fcfdf1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:15 AM >2014-08-23 07:15:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:15:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3761b984 >2014-08-23 07:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3761b984 >2014-08-23 07:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:17:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [7ca67c47] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:17:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [70fcfdf1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:17 AM >2014-08-23 07:19:43,862 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 07:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [4eae47eb] Autorecovering 1 storage domains >2014-08-23 07:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [4eae47eb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [76f585d5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [76f585d5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:20 AM >2014-08-23 07:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bdf67fc >2014-08-23 07:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:22:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7bdf67fc >2014-08-23 07:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4e8fcf1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:22:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [76f585d5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:22 AM >2014-08-23 07:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [70e61714] Autorecovering 1 storage domains >2014-08-23 07:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [70e61714] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [5c81ce97] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [5c81ce97] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:25 AM >2014-08-23 07:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [173d5b61] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [173d5b61] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 776d5d9b >2014-08-23 07:27:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [173d5b61] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:27:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [173d5b61] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 776d5d9b >2014-08-23 07:27:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [173d5b61] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [173d5b61] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:27:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [173d5b61] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:27:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [5c81ce97] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:27 AM >2014-08-23 07:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [339913bb] Autorecovering 1 storage domains >2014-08-23 07:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [339913bb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [29ad2780] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [29ad2780] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:30 AM >2014-08-23 07:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1dd94195 >2014-08-23 07:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1dd94195 >2014-08-23 07:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [739a4c8e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:32:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [29ad2780] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:32 AM >2014-08-23 07:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [17520b06] Autorecovering 1 storage domains >2014-08-23 07:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [17520b06] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [78366607] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [78366607] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:35 AM >2014-08-23 07:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b5575ab >2014-08-23 07:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:37:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3b5575ab >2014-08-23 07:37:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:37:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:37:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6b5bbf43] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:37:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [78366607] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:37 AM >2014-08-23 07:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [db427fe] Autorecovering 1 storage domains >2014-08-23 07:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [db427fe] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [9ceb4c5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [9ceb4c5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:40 AM >2014-08-23 07:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2b78050a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2b78050a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 149f5a05 >2014-08-23 07:40:22,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Attempting to update VMs/Templates Ovf. >2014-08-23 07:40:22,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Attempting to update VM OVFs in Data Center Default >2014-08-23 07:40:22,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Successfully updated VM OVFs in Data Center Default >2014-08-23 07:40:22,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Attempting to update template OVFs in Data Center Default >2014-08-23 07:40:22,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Successfully updated templates OVFs in Data Center Default >2014-08-23 07:40:22,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 07:40:22,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 07:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2b78050a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2b78050a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 149f5a05 >2014-08-23 07:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2b78050a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [2b78050a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2b78050a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [9ceb4c5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:42 AM >2014-08-23 07:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [324b7fe4] Autorecovering 1 storage domains >2014-08-23 07:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [324b7fe4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [52b9f75f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [52b9f75f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:45 AM >2014-08-23 07:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [49591de9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:45:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [49591de9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 384f947b >2014-08-23 07:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [49591de9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:47:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [49591de9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 384f947b >2014-08-23 07:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [49591de9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:47:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [49591de9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [49591de9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:47:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [52b9f75f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:47 AM >2014-08-23 07:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [7b4dde1c] Autorecovering 1 storage domains >2014-08-23 07:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [7b4dde1c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [2bc59801] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [2bc59801] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:50 AM >2014-08-23 07:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 35099c54 >2014-08-23 07:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 35099c54 >2014-08-23 07:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [1b7ba855] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:52:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [2bc59801] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:52 AM >2014-08-23 07:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [4afe65e3] Autorecovering 1 storage domains >2014-08-23 07:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [4afe65e3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 07:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [18449702] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 07:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [18449702] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:55 AM >2014-08-23 07:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 07:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d0d5c81 >2014-08-23 07:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 07:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2d0d5c81 >2014-08-23 07:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 07:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 07:57:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [5c052b7f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 07:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [18449702] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:57 AM >2014-08-23 08:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4c224062] Autorecovering 1 storage domains >2014-08-23 08:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4c224062] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [33c796a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [33c796a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:00 AM >2014-08-23 08:00:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:00:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16365abe >2014-08-23 08:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 16365abe >2014-08-23 08:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:02:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [7ce48ec] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [33c796a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:02 AM >2014-08-23 08:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [51b2ce96] Autorecovering 1 storage domains >2014-08-23 08:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [51b2ce96] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [1724fee1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [1724fee1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:05 AM >2014-08-23 08:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [171fac5a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [171fac5a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 53d5aa8a >2014-08-23 08:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [171fac5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:07:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [171fac5a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 53d5aa8a >2014-08-23 08:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [171fac5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:07:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [171fac5a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [171fac5a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:07:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [1724fee1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:07 AM >2014-08-23 08:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [129485dd] Autorecovering 1 storage domains >2014-08-23 08:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [129485dd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [21c2cce6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [21c2cce6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:10 AM >2014-08-23 08:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [708c17e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [708c17e3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 66a089f2 >2014-08-23 08:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [708c17e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:12:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [708c17e3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 66a089f2 >2014-08-23 08:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [708c17e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [708c17e3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:12:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [708c17e3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:12:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [21c2cce6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:12 AM >2014-08-23 08:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [d7497ed] Autorecovering 1 storage domains >2014-08-23 08:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [d7497ed] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [754a4edc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [754a4edc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:15 AM >2014-08-23 08:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 496c3e86 >2014-08-23 08:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 496c3e86 >2014-08-23 08:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [7d916a9a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [754a4edc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:17 AM >2014-08-23 08:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [56e5de2e] Autorecovering 1 storage domains >2014-08-23 08:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [56e5de2e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [c65bc0e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [c65bc0e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:20 AM >2014-08-23 08:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [163f171a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [163f171a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 45617985 >2014-08-23 08:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [163f171a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [163f171a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 45617985 >2014-08-23 08:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [163f171a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [163f171a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [163f171a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:22:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [c65bc0e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:22 AM >2014-08-23 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [164e5369] Autorecovering 1 storage domains >2014-08-23 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [164e5369] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [6616c8ec] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [6616c8ec] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:25 AM >2014-08-23 08:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [792792cc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [792792cc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 59a0746c >2014-08-23 08:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [792792cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:27:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [792792cc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 59a0746c >2014-08-23 08:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [792792cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [792792cc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:27:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [792792cc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [6616c8ec] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:27 AM >2014-08-23 08:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [2abfb3cd] Autorecovering 1 storage domains >2014-08-23 08:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [2abfb3cd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [d29decd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [d29decd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:30 AM >2014-08-23 08:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [1f980f2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [1f980f2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 533fc9bc >2014-08-23 08:32:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [1f980f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:32:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [1f980f2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 533fc9bc >2014-08-23 08:32:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [1f980f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:32:05,131 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-25) [1f980f2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:32:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [1f980f2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:32:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [d29decd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:32 AM >2014-08-23 08:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [50bc5cc2] Autorecovering 1 storage domains >2014-08-23 08:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [50bc5cc2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [63c317a7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [63c317a7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:35 AM >2014-08-23 08:35:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [7b029491] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:35:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [7b029491] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4cd3ee7 >2014-08-23 08:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [7b029491] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:37:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [7b029491] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4cd3ee7 >2014-08-23 08:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [7b029491] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [7b029491] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:37:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [7b029491] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:37:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [63c317a7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:37 AM >2014-08-23 08:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [345d8c94] Autorecovering 1 storage domains >2014-08-23 08:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [345d8c94] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:40:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [6f4b2987] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [6f4b2987] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:40 AM >2014-08-23 08:40:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:40:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b485d83 >2014-08-23 08:40:22,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Attempting to update VMs/Templates Ovf. >2014-08-23 08:40:22,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Attempting to update VM OVFs in Data Center Default >2014-08-23 08:40:22,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Successfully updated VM OVFs in Data Center Default >2014-08-23 08:40:22,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Attempting to update template OVFs in Data Center Default >2014-08-23 08:40:22,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Successfully updated templates OVFs in Data Center Default >2014-08-23 08:40:22,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 08:40:22,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 08:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:42:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5b485d83 >2014-08-23 08:42:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:42:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [7e8c5ef4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:42:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [6f4b2987] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:42 AM >2014-08-23 08:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [5d500cc7] Autorecovering 1 storage domains >2014-08-23 08:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [5d500cc7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [31ebdc75] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [31ebdc75] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:45 AM >2014-08-23 08:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [14796927] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:45:00,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [14796927] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3731ba7f >2014-08-23 08:47:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [14796927] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:47:05,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [14796927] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3731ba7f >2014-08-23 08:47:05,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [14796927] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:47:05,133 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [14796927] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:47:05,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [14796927] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:47:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [31ebdc75] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:47 AM >2014-08-23 08:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [2ef5fbd4] Autorecovering 1 storage domains >2014-08-23 08:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [2ef5fbd4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [50e8bddd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [50e8bddd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:50 AM >2014-08-23 08:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [204fd908] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [204fd908] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 386fe640 >2014-08-23 08:52:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [204fd908] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:52:05,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [204fd908] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 386fe640 >2014-08-23 08:52:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [204fd908] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:52:05,144 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [204fd908] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:52:05,149 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [204fd908] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:52:05,149 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [50e8bddd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:52 AM >2014-08-23 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [46b0b99d] Autorecovering 1 storage domains >2014-08-23 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [46b0b99d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 08:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [67c3265f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 08:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [67c3265f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:55 AM >2014-08-23 08:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1427b88e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 08:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1427b88e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37042841 >2014-08-23 08:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1427b88e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 08:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1427b88e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 37042841 >2014-08-23 08:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1427b88e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 08:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [1427b88e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 08:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1427b88e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 08:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [67c3265f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:57 AM >2014-08-23 09:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [5aac2bf4] Autorecovering 1 storage domains >2014-08-23 09:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [5aac2bf4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [32d092d2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [32d092d2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:00 AM >2014-08-23 09:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c3d3667 >2014-08-23 09:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5c3d3667 >2014-08-23 09:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:02:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [68e6bb55] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:02:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [32d092d2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:02 AM >2014-08-23 09:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [81136f1] Autorecovering 1 storage domains >2014-08-23 09:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [81136f1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4c3ecaae] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4c3ecaae] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:05 AM >2014-08-23 09:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [92883ac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [92883ac] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 57fe5ef >2014-08-23 09:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [92883ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:07:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [92883ac] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 57fe5ef >2014-08-23 09:07:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [92883ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [92883ac] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:07:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [92883ac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:07:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4c3ecaae] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:07 AM >2014-08-23 09:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [4f7c14ed] Autorecovering 1 storage domains >2014-08-23 09:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [4f7c14ed] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [6a92ff89] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [6a92ff89] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:10 AM >2014-08-23 09:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7252c8ac >2014-08-23 09:12:05,088 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:12:05,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7252c8ac >2014-08-23 09:12:05,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:12:05,089 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:12:05,094 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [5af9ac9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:12:05,094 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [6a92ff89] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:12 AM >2014-08-23 09:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Autorecovering 1 storage domains >2014-08-23 09:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [5c2f97f4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [57729fba] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [57729fba] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:15 AM >2014-08-23 09:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3526eff2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:15:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3526eff2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 24ef2b78 >2014-08-23 09:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3526eff2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3526eff2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 24ef2b78 >2014-08-23 09:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3526eff2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [3526eff2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3526eff2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:17:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [57729fba] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:17 AM >2014-08-23 09:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [1d19f39e] Autorecovering 1 storage domains >2014-08-23 09:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [1d19f39e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [6f03474c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [6f03474c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:20 AM >2014-08-23 09:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 63fcceee >2014-08-23 09:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:22:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 63fcceee >2014-08-23 09:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [2ba9c513] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:22:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [6f03474c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:22 AM >2014-08-23 09:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [9ceb4c5] Autorecovering 1 storage domains >2014-08-23 09:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [9ceb4c5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:25:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [577f5f5b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [577f5f5b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:25 AM >2014-08-23 09:25:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:25:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ebdf49 >2014-08-23 09:27:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:27:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4ebdf49 >2014-08-23 09:27:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:27:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [6920a5f4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:27:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [577f5f5b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:27 AM >2014-08-23 09:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [78366607] Autorecovering 1 storage domains >2014-08-23 09:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [78366607] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [62892cc0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [62892cc0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:30 AM >2014-08-23 09:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d3ae8e6 >2014-08-23 09:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:32:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d3ae8e6 >2014-08-23 09:32:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [1bcb3801] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:32:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [62892cc0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:32 AM >2014-08-23 09:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [4a6fe7d2] Autorecovering 1 storage domains >2014-08-23 09:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [4a6fe7d2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [23a91561] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [23a91561] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:35 AM >2014-08-23 09:35:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:35:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 586a5373 >2014-08-23 09:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:37:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 586a5373 >2014-08-23 09:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:37:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6fd776c4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:37:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [23a91561] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:37 AM >2014-08-23 09:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [3e7876e4] Autorecovering 1 storage domains >2014-08-23 09:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [3e7876e4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [b94a5a2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [b94a5a2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:40 AM >2014-08-23 09:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [12697d70] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [12697d70] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e7bf44b >2014-08-23 09:40:22,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Attempting to update VMs/Templates Ovf. >2014-08-23 09:40:22,581 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Attempting to update VM OVFs in Data Center Default >2014-08-23 09:40:22,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Successfully updated VM OVFs in Data Center Default >2014-08-23 09:40:22,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Attempting to update template OVFs in Data Center Default >2014-08-23 09:40:22,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Successfully updated templates OVFs in Data Center Default >2014-08-23 09:40:22,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 09:40:22,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) [5636814b] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 09:42:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [12697d70] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:42:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [12697d70] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e7bf44b >2014-08-23 09:42:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [12697d70] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:42:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [12697d70] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:42:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [12697d70] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:42:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [b94a5a2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:42 AM >2014-08-23 09:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [57729fba] Autorecovering 1 storage domains >2014-08-23 09:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [57729fba] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [3c0c174f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [3c0c174f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:45 AM >2014-08-23 09:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f2f193 >2014-08-23 09:47:05,153 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:47:05,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f2f193 >2014-08-23 09:47:05,154 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:47:05,154 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:47:05,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [fd8f9fe] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:47:05,159 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [3c0c174f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:47 AM >2014-08-23 09:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [336c55e0] Autorecovering 1 storage domains >2014-08-23 09:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [336c55e0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [420ecaf9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [420ecaf9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:50 AM >2014-08-23 09:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7222e23c >2014-08-23 09:52:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:52:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7222e23c >2014-08-23 09:52:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:52:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:52:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [37b5ca94] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:52:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [420ecaf9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:52 AM >2014-08-23 09:52:45,754 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 09:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [5688a9e6] Autorecovering 1 storage domains >2014-08-23 09:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [5688a9e6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 09:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [162febe5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 09:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [162febe5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:55 AM >2014-08-23 09:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [176bec9e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 09:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [176bec9e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 59ab88d4 >2014-08-23 09:56:45,060 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 09:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [176bec9e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 09:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [176bec9e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 59ab88d4 >2014-08-23 09:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [176bec9e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 09:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [176bec9e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 09:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [176bec9e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 09:57:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [162febe5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:57 AM >2014-08-23 10:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [1a674ed4] Autorecovering 1 storage domains >2014-08-23 10:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [1a674ed4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [7f7a31a4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [7f7a31a4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:00 AM >2014-08-23 10:00:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [28d2900d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:00:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [28d2900d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c232942 >2014-08-23 10:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [28d2900d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [28d2900d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5c232942 >2014-08-23 10:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [28d2900d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [28d2900d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [28d2900d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:02:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [7f7a31a4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:02 AM >2014-08-23 10:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [10aa4590] Autorecovering 1 storage domains >2014-08-23 10:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [10aa4590] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [6f6dec1a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [6f6dec1a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:05 AM >2014-08-23 10:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 39b2e0c7 >2014-08-23 10:07:05,152 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:07:05,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 39b2e0c7 >2014-08-23 10:07:05,153 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:07:05,153 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:07:05,158 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [10c0ffc1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:07:05,158 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [6f6dec1a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:07 AM >2014-08-23 10:07:24,682 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 10:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [6e66129a] Autorecovering 1 storage domains >2014-08-23 10:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [6e66129a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [a575ba9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [a575ba9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:10 AM >2014-08-23 10:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [63749b56] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [63749b56] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3eff7d22 >2014-08-23 10:12:05,140 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [63749b56] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:12:05,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [63749b56] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3eff7d22 >2014-08-23 10:12:05,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [63749b56] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:12:05,141 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [63749b56] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:12:05,145 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [63749b56] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:12:05,146 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [a575ba9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:12 AM >2014-08-23 10:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [1960ead] Autorecovering 1 storage domains >2014-08-23 10:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [1960ead] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:15:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [38843a16] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:15:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [38843a16] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:15 AM >2014-08-23 10:15:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [1959e865] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:15:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [1959e865] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19ed283 >2014-08-23 10:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [1959e865] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [1959e865] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 19ed283 >2014-08-23 10:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [1959e865] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [1959e865] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [1959e865] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [38843a16] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:17 AM >2014-08-23 10:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [34c33350] Autorecovering 1 storage domains >2014-08-23 10:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [34c33350] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [4e2277ba] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [4e2277ba] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:20 AM >2014-08-23 10:20:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:20:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4c6228ed >2014-08-23 10:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4c6228ed >2014-08-23 10:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6ac3e93b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:22:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [4e2277ba] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:22 AM >2014-08-23 10:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [acd6a99] Autorecovering 1 storage domains >2014-08-23 10:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [acd6a99] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [5e388c28] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [5e388c28] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:25 AM >2014-08-23 10:25:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [499accae] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:25:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [499accae] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 157125e1 >2014-08-23 10:27:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [499accae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:27:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [499accae] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 157125e1 >2014-08-23 10:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [499accae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [499accae] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:27:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [499accae] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [5e388c28] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:27 AM >2014-08-23 10:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [4b9df75e] Autorecovering 1 storage domains >2014-08-23 10:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [4b9df75e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [6d1a614] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [6d1a614] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:30 AM >2014-08-23 10:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ad48b8a >2014-08-23 10:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ad48b8a >2014-08-23 10:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1b42cdc8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:32:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [6d1a614] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:32 AM >2014-08-23 10:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [12edb475] Autorecovering 1 storage domains >2014-08-23 10:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [12edb475] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [30a59e3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [30a59e3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:35 AM >2014-08-23 10:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:35:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ffc98ff >2014-08-23 10:37:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:37:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4ffc98ff >2014-08-23 10:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [bf8e68a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:37:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [30a59e3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:37 AM >2014-08-23 10:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [7eb71002] Autorecovering 1 storage domains >2014-08-23 10:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [7eb71002] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [6d191da5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [6d191da5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:40 AM >2014-08-23 10:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e74dddc >2014-08-23 10:40:22,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update VMs/Templates Ovf. >2014-08-23 10:40:22,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update VM OVFs in Data Center Default >2014-08-23 10:40:22,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully updated VM OVFs in Data Center Default >2014-08-23 10:40:22,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update template OVFs in Data Center Default >2014-08-23 10:40:22,589 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully updated templates OVFs in Data Center Default >2014-08-23 10:40:22,589 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 10:40:22,590 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 10:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:42:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4e74dddc >2014-08-23 10:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:42:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [5f6af0d7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:42:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [6d191da5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:42 AM >2014-08-23 10:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [1e3232ca] Autorecovering 1 storage domains >2014-08-23 10:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [1e3232ca] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [4f969442] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [4f969442] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:45 AM >2014-08-23 10:45:00,030 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [ee249cf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:45:00,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [ee249cf] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7639734a >2014-08-23 10:47:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [ee249cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:47:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [ee249cf] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7639734a >2014-08-23 10:47:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [ee249cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:47:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [ee249cf] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:47:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [ee249cf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:47:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [4f969442] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:47 AM >2014-08-23 10:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [4e2277ba] Autorecovering 1 storage domains >2014-08-23 10:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [4e2277ba] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1816bdac] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1816bdac] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:50 AM >2014-08-23 10:50:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [79462b25] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [79462b25] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 152abd70 >2014-08-23 10:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [79462b25] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:52:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [79462b25] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 152abd70 >2014-08-23 10:52:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [79462b25] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [79462b25] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:52:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [79462b25] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:52:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1816bdac] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:52 AM >2014-08-23 10:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [7c164c87] Autorecovering 1 storage domains >2014-08-23 10:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [7c164c87] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 10:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2f51e400] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 10:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2f51e400] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:55 AM >2014-08-23 10:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 10:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5fb16546 >2014-08-23 10:57:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 10:57:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5fb16546 >2014-08-23 10:57:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 10:57:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 10:57:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [1e22e92b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 10:57:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2f51e400] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:57 AM >2014-08-23 11:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [4c3ecaae] Autorecovering 1 storage domains >2014-08-23 11:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [4c3ecaae] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [1e50270] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [1e50270] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:00 AM >2014-08-23 11:00:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2c175543 >2014-08-23 11:02:05,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:02:05,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2c175543 >2014-08-23 11:02:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:02:05,143 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:02:05,147 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [67ac3bee] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:02:05,148 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [1e50270] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:02 AM >2014-08-23 11:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [6f7cce3d] Autorecovering 1 storage domains >2014-08-23 11:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [6f7cce3d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [64c4c4bd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [64c4c4bd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:05 AM >2014-08-23 11:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 51d7a429 >2014-08-23 11:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 51d7a429 >2014-08-23 11:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [7fd619d9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:07:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [64c4c4bd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:07 AM >2014-08-23 11:08:16,139 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 11:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [6aaee2d1] Autorecovering 1 storage domains >2014-08-23 11:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [6aaee2d1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [130f6284] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [130f6284] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:10 AM >2014-08-23 11:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [321c1b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [321c1b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 261e9ebe >2014-08-23 11:12:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [321c1b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:12:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [321c1b6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 261e9ebe >2014-08-23 11:12:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [321c1b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:12:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [321c1b6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:12:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [321c1b6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:12:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [130f6284] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:12 AM >2014-08-23 11:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [62892cc0] Autorecovering 1 storage domains >2014-08-23 11:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [62892cc0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3aece383] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3aece383] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:15 AM >2014-08-23 11:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e77f07 >2014-08-23 11:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4e77f07 >2014-08-23 11:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [7719a6b3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:17:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3aece383] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:17 AM >2014-08-23 11:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [bca9447] Autorecovering 1 storage domains >2014-08-23 11:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [bca9447] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [7492a046] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [7492a046] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:20 AM >2014-08-23 11:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3e3c2693 >2014-08-23 11:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:22:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3e3c2693 >2014-08-23 11:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [25c0c26f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [7492a046] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:22 AM >2014-08-23 11:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [26794939] Autorecovering 1 storage domains >2014-08-23 11:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [26794939] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6fb4971] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6fb4971] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:25 AM >2014-08-23 11:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [7a704833] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [7a704833] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f9f53c6 >2014-08-23 11:27:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [7a704833] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:27:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [7a704833] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f9f53c6 >2014-08-23 11:27:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [7a704833] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:27:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [7a704833] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:27:05,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [7a704833] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:27:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6fb4971] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:27 AM >2014-08-23 11:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [196e6486] Autorecovering 1 storage domains >2014-08-23 11:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [196e6486] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [5fffc26f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [5fffc26f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:30 AM >2014-08-23 11:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 365b48b2 >2014-08-23 11:32:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:32:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 365b48b2 >2014-08-23 11:32:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:32:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [63a2bd74] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:32:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [5fffc26f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:32 AM >2014-08-23 11:34:01,717 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 11:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [2f51e400] Autorecovering 1 storage domains >2014-08-23 11:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [2f51e400] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:35 AM >2014-08-23 11:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [593e159a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [593e159a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6cfdb363 >2014-08-23 11:37:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [593e159a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:37:05,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [593e159a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6cfdb363 >2014-08-23 11:37:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [593e159a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:37:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [593e159a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:37:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [593e159a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:37:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:37 AM >2014-08-23 11:39:04,658 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 11:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [6f6dec1a] Autorecovering 1 storage domains >2014-08-23 11:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [6f6dec1a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7be73929] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7be73929] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:40 AM >2014-08-23 11:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 352e62ed >2014-08-23 11:40:22,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Attempting to update VMs/Templates Ovf. >2014-08-23 11:40:22,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Attempting to update VM OVFs in Data Center Default >2014-08-23 11:40:22,594 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Successfully updated VM OVFs in Data Center Default >2014-08-23 11:40:22,594 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Attempting to update template OVFs in Data Center Default >2014-08-23 11:40:22,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Successfully updated templates OVFs in Data Center Default >2014-08-23 11:40:22,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 11:40:22,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [570b47a6] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 11:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:42:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 352e62ed >2014-08-23 11:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:42:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2952b7b6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7be73929] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:42 AM >2014-08-23 11:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [570b47a6] Autorecovering 1 storage domains >2014-08-23 11:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [570b47a6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2b4cdd82] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2b4cdd82] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:45 AM >2014-08-23 11:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70a60cf8 >2014-08-23 11:47:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:47:05,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 70a60cf8 >2014-08-23 11:47:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:47:05,119 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:47:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [5d16aa7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:47:05,124 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2b4cdd82] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:47 AM >2014-08-23 11:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [130f6284] Autorecovering 1 storage domains >2014-08-23 11:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [130f6284] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [232c88c6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [232c88c6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:50 AM >2014-08-23 11:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [27212d00] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [27212d00] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47dcacb4 >2014-08-23 11:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [27212d00] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [27212d00] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 47dcacb4 >2014-08-23 11:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [27212d00] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [27212d00] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:52:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [27212d00] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:52:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [232c88c6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:52 AM >2014-08-23 11:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [2bc59801] Autorecovering 1 storage domains >2014-08-23 11:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [2bc59801] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 11:55:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [4d99a2ca] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 11:55:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [4d99a2ca] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:55 AM >2014-08-23 11:55:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [4554e226] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 11:55:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4554e226] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68fa0754 >2014-08-23 11:57:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [4554e226] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 11:57:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4554e226] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68fa0754 >2014-08-23 11:57:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [4554e226] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 11:57:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-27) [4554e226] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 11:57:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [4554e226] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 11:57:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [4d99a2ca] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:57 AM >2014-08-23 12:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [50e8bddd] Autorecovering 1 storage domains >2014-08-23 12:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [50e8bddd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [56e4cb3b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [56e4cb3b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:00 PM >2014-08-23 12:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [260cf164] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [260cf164] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b8ab886 >2014-08-23 12:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [260cf164] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [260cf164] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b8ab886 >2014-08-23 12:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [260cf164] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [260cf164] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [260cf164] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:02:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [56e4cb3b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:02 PM >2014-08-23 12:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [192598f4] Autorecovering 1 storage domains >2014-08-23 12:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [192598f4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [7680158a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [7680158a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:05 PM >2014-08-23 12:05:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2929b78a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:05:00,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2929b78a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18bb0091 >2014-08-23 12:07:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [2929b78a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:07:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2929b78a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 18bb0091 >2014-08-23 12:07:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [2929b78a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:07:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [2929b78a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:07:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2929b78a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:07:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [7680158a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:07 PM >2014-08-23 12:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [36819a69] Autorecovering 1 storage domains >2014-08-23 12:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [36819a69] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [33a5261a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [33a5261a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:10 PM >2014-08-23 12:10:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [215afb3f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:10:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [215afb3f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ea1e91d >2014-08-23 12:12:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [215afb3f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:12:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [215afb3f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5ea1e91d >2014-08-23 12:12:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [215afb3f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:12:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [215afb3f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:12:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [215afb3f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:12:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [33a5261a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:12 PM >2014-08-23 12:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [268e936a] Autorecovering 1 storage domains >2014-08-23 12:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [268e936a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6b899e0e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6b899e0e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:15 PM >2014-08-23 12:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [cd1941e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [cd1941e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2be0fa87 >2014-08-23 12:17:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [cd1941e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:17:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [cd1941e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2be0fa87 >2014-08-23 12:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [cd1941e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:17:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [cd1941e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [cd1941e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:17:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6b899e0e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:17 PM >2014-08-23 12:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [609fb656] Autorecovering 1 storage domains >2014-08-23 12:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [609fb656] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [59663ab] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [59663ab] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:20 PM >2014-08-23 12:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [29042221] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [29042221] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2aaa0c46 >2014-08-23 12:22:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [29042221] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:22:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [29042221] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2aaa0c46 >2014-08-23 12:22:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [29042221] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:22:05,128 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [29042221] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:22:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [29042221] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:22:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [59663ab] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:22 PM >2014-08-23 12:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [6d191da5] Autorecovering 1 storage domains >2014-08-23 12:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [6d191da5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [288096a8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [288096a8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:25 PM >2014-08-23 12:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 247a7ae7 >2014-08-23 12:27:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:27:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 247a7ae7 >2014-08-23 12:27:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:27:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:27:05,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1d9a23ef] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:27:05,121 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [288096a8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:27 PM >2014-08-23 12:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [6a92ff89] Autorecovering 1 storage domains >2014-08-23 12:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [6a92ff89] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [13250d88] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [13250d88] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:30 PM >2014-08-23 12:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [5d879146] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [5d879146] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7feb28b5 >2014-08-23 12:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [5d879146] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:32:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [5d879146] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7feb28b5 >2014-08-23 12:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [5d879146] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [5d879146] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:32:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [5d879146] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:32:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [13250d88] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:32 PM >2014-08-23 12:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [c65bc0e] Autorecovering 1 storage domains >2014-08-23 12:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [c65bc0e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [13a93e19] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [13a93e19] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:35 PM >2014-08-23 12:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [20572ae9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [20572ae9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 67c437d9 >2014-08-23 12:37:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [20572ae9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:37:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [20572ae9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 67c437d9 >2014-08-23 12:37:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [20572ae9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:37:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [20572ae9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:37:05,137 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [20572ae9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:37:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [13a93e19] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:37 PM >2014-08-23 12:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [5bee200e] Autorecovering 1 storage domains >2014-08-23 12:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [5bee200e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6891e298] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6891e298] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:40 PM >2014-08-23 12:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [9d373ec] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [9d373ec] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: aa6b876 >2014-08-23 12:40:22,598 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Attempting to update VMs/Templates Ovf. >2014-08-23 12:40:22,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Attempting to update VM OVFs in Data Center Default >2014-08-23 12:40:22,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Successfully updated VM OVFs in Data Center Default >2014-08-23 12:40:22,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Attempting to update template OVFs in Data Center Default >2014-08-23 12:40:22,601 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Successfully updated templates OVFs in Data Center Default >2014-08-23 12:40:22,601 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 12:40:22,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [41549a97] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 12:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [9d373ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [9d373ec] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: aa6b876 >2014-08-23 12:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [9d373ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [9d373ec] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [9d373ec] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:42:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6891e298] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:42 PM >2014-08-23 12:44:28,794 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 12:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Autorecovering 1 storage domains >2014-08-23 12:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [2fc552bf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4e496263] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4e496263] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:45 PM >2014-08-23 12:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [76117647] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:45:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [76117647] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ee8f3d8 >2014-08-23 12:47:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [76117647] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:47:05,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [76117647] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ee8f3d8 >2014-08-23 12:47:05,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [76117647] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:47:05,133 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [76117647] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:47:05,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [76117647] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:47:05,140 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4e496263] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:47 PM >2014-08-23 12:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [47d6ff53] Autorecovering 1 storage domains >2014-08-23 12:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [47d6ff53] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:50:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [21e9216e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:50:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [21e9216e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:50 PM >2014-08-23 12:50:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:50:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5a82fa84 >2014-08-23 12:52:05,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:52:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5a82fa84 >2014-08-23 12:52:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:52:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:52:05,133 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3cfbbc23] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:52:05,133 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [21e9216e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:52 PM >2014-08-23 12:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [21601c11] Autorecovering 1 storage domains >2014-08-23 12:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [21601c11] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 12:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6a89a416] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 12:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6a89a416] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 12:55 PM >2014-08-23 12:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [154bb5c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 12:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [154bb5c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: c477099 >2014-08-23 12:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [154bb5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 12:57:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [154bb5c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: c477099 >2014-08-23 12:57:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [154bb5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 12:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [154bb5c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 12:57:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [154bb5c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 12:57:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6a89a416] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 12:57 PM >2014-08-23 13:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [29ad2780] Autorecovering 1 storage domains >2014-08-23 13:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [29ad2780] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [213d2613] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [213d2613] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:00 PM >2014-08-23 13:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 36afdb8b >2014-08-23 13:02:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:02:05,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 36afdb8b >2014-08-23 13:02:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:02:05,133 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:02:05,137 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [48a3f72a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:02:05,137 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [213d2613] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:02 PM >2014-08-23 13:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [288096a8] Autorecovering 1 storage domains >2014-08-23 13:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [288096a8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [78167579] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [78167579] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:05 PM >2014-08-23 13:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 515a2f4b >2014-08-23 13:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 515a2f4b >2014-08-23 13:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [6b49ab2c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [78167579] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:07 PM >2014-08-23 13:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [ceb8fc6] Autorecovering 1 storage domains >2014-08-23 13:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [ceb8fc6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [31b5ee83] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:10 PM >2014-08-23 13:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [729748c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [729748c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47fa1125 >2014-08-23 13:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [729748c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:12:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [729748c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 47fa1125 >2014-08-23 13:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [729748c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:12:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [729748c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [729748c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:12:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [31b5ee83] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:12 PM >2014-08-23 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [7a056e8b] Autorecovering 1 storage domains >2014-08-23 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [7a056e8b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [2803df71] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [2803df71] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:15 PM >2014-08-23 13:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3f217172] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3f217172] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17886378 >2014-08-23 13:17:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3f217172] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:17:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3f217172] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17886378 >2014-08-23 13:17:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3f217172] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:17:05,116 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [3f217172] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:17:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3f217172] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:17:05,119 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [2803df71] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:17 PM >2014-08-23 13:18:34,211 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 13:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [21c2cce6] Autorecovering 1 storage domains >2014-08-23 13:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [21c2cce6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [59354db7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [59354db7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:20 PM >2014-08-23 13:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [54396017] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:20:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [54396017] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 76196e70 >2014-08-23 13:20:35,374 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 13:22:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [54396017] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:22:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [54396017] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 76196e70 >2014-08-23 13:22:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [54396017] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:22:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [54396017] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [54396017] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:22:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [59354db7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:22 PM >2014-08-23 13:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [1724fee1] Autorecovering 1 storage domains >2014-08-23 13:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [1724fee1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [3310e790] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [3310e790] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:25 PM >2014-08-23 13:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [745e432] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [745e432] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 210f93cd >2014-08-23 13:27:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [745e432] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:27:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [745e432] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 210f93cd >2014-08-23 13:27:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [745e432] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:27:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [745e432] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:27:05,137 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [745e432] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:27:05,137 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [3310e790] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:27 PM >2014-08-23 13:27:09,431 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 13:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [2b4cdd82] Autorecovering 1 storage domains >2014-08-23 13:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [2b4cdd82] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [92a3bce] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [92a3bce] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:30 PM >2014-08-23 13:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [8c0d432] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [8c0d432] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33d7567c >2014-08-23 13:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [8c0d432] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:32:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [8c0d432] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33d7567c >2014-08-23 13:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [8c0d432] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:32:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [8c0d432] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [8c0d432] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [92a3bce] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:32 PM >2014-08-23 13:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [5e388c28] Autorecovering 1 storage domains >2014-08-23 13:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [5e388c28] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7f76075] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7f76075] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:35 PM >2014-08-23 13:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a26cfd7 >2014-08-23 13:37:05,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:37:05,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4a26cfd7 >2014-08-23 13:37:05,095 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:37:05,095 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:37:05,101 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [4330a0c0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:37:05,101 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7f76075] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:37 PM >2014-08-23 13:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [6e59dc86] Autorecovering 1 storage domains >2014-08-23 13:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [6e59dc86] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [28a58e63] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [28a58e63] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:40 PM >2014-08-23 13:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65e9b22c >2014-08-23 13:40:22,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Attempting to update VMs/Templates Ovf. >2014-08-23 13:40:22,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Attempting to update VM OVFs in Data Center Default >2014-08-23 13:40:22,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Successfully updated VM OVFs in Data Center Default >2014-08-23 13:40:22,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Attempting to update template OVFs in Data Center Default >2014-08-23 13:40:22,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Successfully updated templates OVFs in Data Center Default >2014-08-23 13:40:22,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 13:40:22,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [30a59e3] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 13:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65e9b22c >2014-08-23 13:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [384a7c3b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:42:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [28a58e63] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:42 PM >2014-08-23 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [30a59e3] Autorecovering 1 storage domains >2014-08-23 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [30a59e3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [1ead4d39] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [1ead4d39] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:45 PM >2014-08-23 13:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [37670f7b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:45:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [37670f7b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e760e91 >2014-08-23 13:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [37670f7b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:47:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [37670f7b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e760e91 >2014-08-23 13:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [37670f7b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:47:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [37670f7b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [37670f7b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:47:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [1ead4d39] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:47 PM >2014-08-23 13:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [33f038bc] Autorecovering 1 storage domains >2014-08-23 13:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [33f038bc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [68d5fd34] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [68d5fd34] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:50 PM >2014-08-23 13:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: b7e9f09 >2014-08-23 13:52:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:52:05,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: b7e9f09 >2014-08-23 13:52:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:52:05,123 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:52:05,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3bd590ca] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:52:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [68d5fd34] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:52 PM >2014-08-23 13:53:55,652 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 13:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [6616c8ec] Autorecovering 1 storage domains >2014-08-23 13:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [6616c8ec] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 13:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [7cd89be6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 13:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [7cd89be6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 1:55 PM >2014-08-23 13:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [47b7965b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 13:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [47b7965b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4155ca2f >2014-08-23 13:57:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [47b7965b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 13:57:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [47b7965b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4155ca2f >2014-08-23 13:57:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [47b7965b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 13:57:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [47b7965b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 13:57:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [47b7965b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 13:57:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [7cd89be6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 1:57 PM >2014-08-23 14:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [79d6c963] Autorecovering 1 storage domains >2014-08-23 14:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [79d6c963] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [153eef6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [153eef6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:00 PM >2014-08-23 14:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2069f241 >2014-08-23 14:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:02:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2069f241 >2014-08-23 14:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [4d2c7398] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [153eef6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:02 PM >2014-08-23 14:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [3807e396] Autorecovering 1 storage domains >2014-08-23 14:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [3807e396] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6de5c4a1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6de5c4a1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:05 PM >2014-08-23 14:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [354a09bf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [354a09bf] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 328383e9 >2014-08-23 14:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [354a09bf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:07:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [354a09bf] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 328383e9 >2014-08-23 14:07:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [354a09bf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [354a09bf] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:07:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [354a09bf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:07:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6de5c4a1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:07 PM >2014-08-23 14:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [92a3bce] Autorecovering 1 storage domains >2014-08-23 14:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [92a3bce] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [3f50693] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [3f50693] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:10 PM >2014-08-23 14:10:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:10:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 12218b89 >2014-08-23 14:12:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:12:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 12218b89 >2014-08-23 14:12:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:12:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [7c2e0157] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:12:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [3f50693] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:12 PM >2014-08-23 14:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [c4ec87b] Autorecovering 1 storage domains >2014-08-23 14:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [c4ec87b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [679374e8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [679374e8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:15 PM >2014-08-23 14:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [6135abd5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [6135abd5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 66a5ca5c >2014-08-23 14:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [6135abd5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [6135abd5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 66a5ca5c >2014-08-23 14:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [6135abd5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [6135abd5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [6135abd5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [679374e8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:17 PM >2014-08-23 14:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [68d5fd34] Autorecovering 1 storage domains >2014-08-23 14:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [68d5fd34] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:20 PM >2014-08-23 14:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [177a6a78] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [177a6a78] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3bc00005 >2014-08-23 14:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [177a6a78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:22:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [177a6a78] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3bc00005 >2014-08-23 14:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [177a6a78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [177a6a78] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [177a6a78] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:22 PM >2014-08-23 14:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [3aece383] Autorecovering 1 storage domains >2014-08-23 14:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [3aece383] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2979ea3f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2979ea3f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:25 PM >2014-08-23 14:25:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [127ea707] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:25:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [127ea707] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4be84a49 >2014-08-23 14:27:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [127ea707] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:27:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [127ea707] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4be84a49 >2014-08-23 14:27:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [127ea707] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:27:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [127ea707] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [127ea707] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:27:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2979ea3f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:27 PM >2014-08-23 14:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [4e496263] Autorecovering 1 storage domains >2014-08-23 14:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [4e496263] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4da62f93] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4da62f93] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:30 PM >2014-08-23 14:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [d276fc9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [d276fc9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2f6a8269 >2014-08-23 14:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [d276fc9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:32:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [d276fc9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2f6a8269 >2014-08-23 14:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [d276fc9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:32:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [d276fc9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [d276fc9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [4da62f93] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:32 PM >2014-08-23 14:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [f4900f5] Autorecovering 1 storage domains >2014-08-23 14:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [f4900f5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [70fb9422] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [70fb9422] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:35 PM >2014-08-23 14:35:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:35:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33a820fc >2014-08-23 14:37:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:37:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33a820fc >2014-08-23 14:37:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:37:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:37:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [3c3be46d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:37:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [70fb9422] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:37 PM >2014-08-23 14:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [7b74b5e1] Autorecovering 1 storage domains >2014-08-23 14:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [7b74b5e1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [638e8a2a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [638e8a2a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:40 PM >2014-08-23 14:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4fa80a05 >2014-08-23 14:40:22,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Attempting to update VMs/Templates Ovf. >2014-08-23 14:40:22,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Attempting to update VM OVFs in Data Center Default >2014-08-23 14:40:22,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Successfully updated VM OVFs in Data Center Default >2014-08-23 14:40:22,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Attempting to update template OVFs in Data Center Default >2014-08-23 14:40:22,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Successfully updated templates OVFs in Data Center Default >2014-08-23 14:40:22,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 14:40:22,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 14:42:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:42:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4fa80a05 >2014-08-23 14:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:42:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [5fa6f160] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [638e8a2a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:42 PM >2014-08-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [577f5f5b] Autorecovering 1 storage domains >2014-08-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [577f5f5b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [65ba0084] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [65ba0084] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:45 PM >2014-08-23 14:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [623d907f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [623d907f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7e3406aa >2014-08-23 14:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [623d907f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:47:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [623d907f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7e3406aa >2014-08-23 14:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [623d907f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:47:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [623d907f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [623d907f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [65ba0084] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:47 PM >2014-08-23 14:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [3f50693] Autorecovering 1 storage domains >2014-08-23 14:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [3f50693] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [19283aa5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [19283aa5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:50 PM >2014-08-23 14:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4af847ac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4af847ac] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d2d5df2 >2014-08-23 14:52:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4af847ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:52:05,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4af847ac] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1d2d5df2 >2014-08-23 14:52:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4af847ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:52:05,144 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [4af847ac] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:52:05,149 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4af847ac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:52:05,149 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [19283aa5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:52 PM >2014-08-23 14:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [3caeaef] Autorecovering 1 storage domains >2014-08-23 14:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [3caeaef] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 14:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [727792e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 14:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [727792e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 2:55 PM >2014-08-23 14:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [47c36539] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 14:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [47c36539] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 48b9d367 >2014-08-23 14:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [47c36539] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 14:57:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [47c36539] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 48b9d367 >2014-08-23 14:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [47c36539] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 14:57:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [47c36539] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 14:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [47c36539] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 14:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [727792e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 2:57 PM >2014-08-23 15:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [12787e47] Autorecovering 1 storage domains >2014-08-23 15:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [12787e47] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [38378213] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [38378213] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:00 PM >2014-08-23 15:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [731e5095] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [731e5095] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ed9401e >2014-08-23 15:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [731e5095] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:02:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [731e5095] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5ed9401e >2014-08-23 15:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [731e5095] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:02:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-46) [731e5095] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [731e5095] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [38378213] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:02 PM >2014-08-23 15:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [7680158a] Autorecovering 1 storage domains >2014-08-23 15:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [7680158a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [1a03e729] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [1a03e729] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:05 PM >2014-08-23 15:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [9e67275] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [9e67275] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 448307a1 >2014-08-23 15:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [9e67275] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [9e67275] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 448307a1 >2014-08-23 15:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [9e67275] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [9e67275] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [9e67275] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:07:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [1a03e729] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:07 PM >2014-08-23 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [64c4c4bd] Autorecovering 1 storage domains >2014-08-23 15:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [64c4c4bd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [dcf614d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [dcf614d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:10 PM >2014-08-23 15:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [68b3675c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [68b3675c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5a613a69 >2014-08-23 15:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [68b3675c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [68b3675c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5a613a69 >2014-08-23 15:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [68b3675c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [68b3675c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [68b3675c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [dcf614d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:12 PM >2014-08-23 15:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [41549a97] Autorecovering 1 storage domains >2014-08-23 15:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [41549a97] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [23e16c9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [23e16c9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:15 PM >2014-08-23 15:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 57c8f7b9 >2014-08-23 15:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 57c8f7b9 >2014-08-23 15:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1a70a43a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:17:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [23e16c9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:17 PM >2014-08-23 15:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [7f7a31a4] Autorecovering 1 storage domains >2014-08-23 15:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [7f7a31a4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [41c58941] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [41c58941] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:20 PM >2014-08-23 15:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [58f20a43] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [58f20a43] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22753ca6 >2014-08-23 15:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [58f20a43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:22:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [58f20a43] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 22753ca6 >2014-08-23 15:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [58f20a43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [58f20a43] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [58f20a43] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:22:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [41c58941] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:22 PM >2014-08-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [6f4b2987] Autorecovering 1 storage domains >2014-08-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [6f4b2987] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [3f05064] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [3f05064] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:25 PM >2014-08-23 15:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69d67dc2 >2014-08-23 15:27:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:27:05,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69d67dc2 >2014-08-23 15:27:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:27:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:27:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [2cacde6f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:27:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [3f05064] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:27 PM >2014-08-23 15:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [76f585d5] Autorecovering 1 storage domains >2014-08-23 15:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [76f585d5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [766ee87] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [766ee87] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:30 PM >2014-08-23 15:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [5c418f37] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [5c418f37] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d58b45f >2014-08-23 15:32:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [5c418f37] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:32:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [5c418f37] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d58b45f >2014-08-23 15:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [5c418f37] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:32:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [5c418f37] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [5c418f37] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [766ee87] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:32 PM >2014-08-23 15:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [18449702] Autorecovering 1 storage domains >2014-08-23 15:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [18449702] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [19f2ab5b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [19f2ab5b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:35 PM >2014-08-23 15:35:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [4460efbe] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [4460efbe] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4669efd >2014-08-23 15:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [4460efbe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:37:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [4460efbe] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4669efd >2014-08-23 15:37:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [4460efbe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [4460efbe] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:37:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [4460efbe] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:37:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [19f2ab5b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:37 PM >2014-08-23 15:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [21e9216e] Autorecovering 1 storage domains >2014-08-23 15:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [21e9216e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [1739690c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [1739690c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:40 PM >2014-08-23 15:40:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:40:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 679caa1 >2014-08-23 15:40:22,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Attempting to update VMs/Templates Ovf. >2014-08-23 15:40:22,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Attempting to update VM OVFs in Data Center Default >2014-08-23 15:40:22,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Successfully updated VM OVFs in Data Center Default >2014-08-23 15:40:22,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Attempting to update template OVFs in Data Center Default >2014-08-23 15:40:22,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Successfully updated templates OVFs in Data Center Default >2014-08-23 15:40:22,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 15:40:22,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [13a93e19] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 15:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 679caa1 >2014-08-23 15:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:42:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [7170b8a1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [1739690c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:42 PM >2014-08-23 15:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [5eb28db9] Autorecovering 1 storage domains >2014-08-23 15:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [5eb28db9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [5834e4a5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [5834e4a5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:45 PM >2014-08-23 15:45:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [203d94cb] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:45:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [203d94cb] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5caae8ed >2014-08-23 15:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [203d94cb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:47:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [203d94cb] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5caae8ed >2014-08-23 15:47:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [203d94cb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:47:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [203d94cb] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:47:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [203d94cb] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:47:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [5834e4a5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:47 PM >2014-08-23 15:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [33c796a] Autorecovering 1 storage domains >2014-08-23 15:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [33c796a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [5105d10a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [5105d10a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:50 PM >2014-08-23 15:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21ee184d >2014-08-23 15:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 21ee184d >2014-08-23 15:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:52:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [fd6c08c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [5105d10a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:52 PM >2014-08-23 15:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [153eef6] Autorecovering 1 storage domains >2014-08-23 15:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [153eef6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 15:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ae60c06] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 15:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ae60c06] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 3:55 PM >2014-08-23 15:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 15:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 28b0653e >2014-08-23 15:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 15:57:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 28b0653e >2014-08-23 15:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 15:57:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 15:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [6dc654ea] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 15:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ae60c06] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 3:57 PM >2014-08-23 16:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [5e0f4c6a] Autorecovering 1 storage domains >2014-08-23 16:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [5e0f4c6a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [13906535] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [13906535] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:00 PM >2014-08-23 16:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [2097e08b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [2097e08b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 169bbbbe >2014-08-23 16:02:05,134 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [2097e08b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:02:05,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [2097e08b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 169bbbbe >2014-08-23 16:02:05,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [2097e08b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:02:05,135 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [2097e08b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:02:05,140 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [2097e08b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:02:05,140 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [13906535] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:02 PM >2014-08-23 16:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [3f05064] Autorecovering 1 storage domains >2014-08-23 16:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [3f05064] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [4126de99] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [4126de99] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:05 PM >2014-08-23 16:05:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:05:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 513606cd >2014-08-23 16:07:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:07:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 513606cd >2014-08-23 16:07:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:07:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:07:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4aa10db1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:07:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [4126de99] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:07 PM >2014-08-23 16:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [7bb3af0d] Autorecovering 1 storage domains >2014-08-23 16:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [7bb3af0d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6de86979] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6de86979] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:10 PM >2014-08-23 16:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [38cd924e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [38cd924e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 232b5377 >2014-08-23 16:12:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [38cd924e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:12:05,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [38cd924e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 232b5377 >2014-08-23 16:12:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [38cd924e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:12:05,119 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [38cd924e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:12:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [38cd924e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:12:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6de86979] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:12 PM >2014-08-23 16:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [78167579] Autorecovering 1 storage domains >2014-08-23 16:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [78167579] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4a63161d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:15:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4a63161d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:15 PM >2014-08-23 16:15:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:15:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5e506dd0 >2014-08-23 16:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5e506dd0 >2014-08-23 16:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:17:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [6e1746f1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:17:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4a63161d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:17 PM >2014-08-23 16:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [65ba0084] Autorecovering 1 storage domains >2014-08-23 16:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [65ba0084] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [40b8e60e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [40b8e60e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:20 PM >2014-08-23 16:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 34f861d9 >2014-08-23 16:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:22:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 34f861d9 >2014-08-23 16:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:22:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [7a28f9e3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:22:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [40b8e60e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:22 PM >2014-08-23 16:22:39,577 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [5834e4a5] Autorecovering 1 storage domains >2014-08-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [5834e4a5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [17963593] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [17963593] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:25 PM >2014-08-23 16:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 71765d79 >2014-08-23 16:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:27:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 71765d79 >2014-08-23 16:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:27:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [5dea2d4f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:27:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [17963593] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:27 PM >2014-08-23 16:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [13906535] Autorecovering 1 storage domains >2014-08-23 16:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [13906535] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [1dd9b94] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [1dd9b94] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:30 PM >2014-08-23 16:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [68725d0e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [68725d0e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 9eb9611 >2014-08-23 16:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [68725d0e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [68725d0e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 9eb9611 >2014-08-23 16:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [68725d0e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:32:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [68725d0e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [68725d0e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:32:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [1dd9b94] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:32 PM >2014-08-23 16:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [19283aa5] Autorecovering 1 storage domains >2014-08-23 16:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [19283aa5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2362bc5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2362bc5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:35 PM >2014-08-23 16:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7ca648da >2014-08-23 16:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:37:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7ca648da >2014-08-23 16:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:37:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [7f1b41a8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:37:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [2362bc5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:37 PM >2014-08-23 16:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [7492a046] Autorecovering 1 storage domains >2014-08-23 16:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [7492a046] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [6d08134c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [6d08134c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:40 PM >2014-08-23 16:40:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:40:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a16735e >2014-08-23 16:40:22,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Attempting to update VMs/Templates Ovf. >2014-08-23 16:40:22,621 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Attempting to update VM OVFs in Data Center Default >2014-08-23 16:40:22,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Successfully updated VM OVFs in Data Center Default >2014-08-23 16:40:22,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Attempting to update template OVFs in Data Center Default >2014-08-23 16:40:22,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Successfully updated templates OVFs in Data Center Default >2014-08-23 16:40:22,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 16:40:22,625 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [4716763e] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 16:42:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:42:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4a16735e >2014-08-23 16:42:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:42:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:42:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [6fbdd36] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:42:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [6d08134c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:42 PM >2014-08-23 16:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [38378213] Autorecovering 1 storage domains >2014-08-23 16:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [38378213] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7fca81f0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7fca81f0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:45 PM >2014-08-23 16:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1e428e82] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1e428e82] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50ac6895 >2014-08-23 16:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1e428e82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:47:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1e428e82] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 50ac6895 >2014-08-23 16:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1e428e82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:47:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [1e428e82] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:47:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1e428e82] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:47:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7fca81f0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:47 PM >2014-08-23 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [52b9f75f] Autorecovering 1 storage domains >2014-08-23 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [52b9f75f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [1a433c8b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [1a433c8b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:50 PM >2014-08-23 16:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69de11f3 >2014-08-23 16:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:52:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69de11f3 >2014-08-23 16:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [3958a8cf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:52:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [1a433c8b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:52 PM >2014-08-23 16:54:13,721 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 16:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [55451e14] Autorecovering 1 storage domains >2014-08-23 16:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [55451e14] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 16:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [37200f4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 16:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [37200f4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 4:55 PM >2014-08-23 16:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [49ea978e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 16:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [49ea978e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d06ce66 >2014-08-23 16:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [49ea978e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 16:57:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [49ea978e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1d06ce66 >2014-08-23 16:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [49ea978e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 16:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [49ea978e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 16:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [49ea978e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 16:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [37200f4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 4:57 PM >2014-08-23 17:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [1a03e729] Autorecovering 1 storage domains >2014-08-23 17:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [1a03e729] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [68a89df3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [68a89df3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:00 PM >2014-08-23 17:00:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [6d90335e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [6d90335e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f4f714d >2014-08-23 17:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [6d90335e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:02:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [6d90335e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3f4f714d >2014-08-23 17:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [6d90335e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [6d90335e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [6d90335e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [68a89df3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:02 PM >2014-08-23 17:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [6a931f45] Autorecovering 1 storage domains >2014-08-23 17:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [6a931f45] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [255cb5a8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [255cb5a8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:05 PM >2014-08-23 17:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [208d1915] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [208d1915] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56f159ab >2014-08-23 17:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [208d1915] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [208d1915] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 56f159ab >2014-08-23 17:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [208d1915] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [208d1915] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [208d1915] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [255cb5a8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:07 PM >2014-08-23 17:07:21,565 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 17:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [754a4edc] Autorecovering 1 storage domains >2014-08-23 17:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [754a4edc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3f0358fc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3f0358fc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:10 PM >2014-08-23 17:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [11fef911] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [11fef911] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 215d135b >2014-08-23 17:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [11fef911] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:12:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [11fef911] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 215d135b >2014-08-23 17:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [11fef911] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [11fef911] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [11fef911] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3f0358fc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:12 PM >2014-08-23 17:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [67c3265f] Autorecovering 1 storage domains >2014-08-23 17:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [67c3265f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [59cb3676] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [59cb3676] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:15 PM >2014-08-23 17:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5471a84a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5471a84a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2c2b898e >2014-08-23 17:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5471a84a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:17:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5471a84a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2c2b898e >2014-08-23 17:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5471a84a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [5471a84a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5471a84a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:17:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [59cb3676] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:17 PM >2014-08-23 17:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [33a5261a] Autorecovering 1 storage domains >2014-08-23 17:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [33a5261a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [7cfa1f85] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [7cfa1f85] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:20 PM >2014-08-23 17:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 567f28ca >2014-08-23 17:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 567f28ca >2014-08-23 17:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [5c2b98ad] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [7cfa1f85] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:22 PM >2014-08-23 17:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [6d1a614] Autorecovering 1 storage domains >2014-08-23 17:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [6d1a614] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [45980cfb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [45980cfb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:25 PM >2014-08-23 17:25:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [1f144493] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:25:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1f144493] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 201be65 >2014-08-23 17:27:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [1f144493] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:27:05,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [1f144493] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 201be65 >2014-08-23 17:27:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [1f144493] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:27:05,129 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [1f144493] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:27:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [1f144493] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:27:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [45980cfb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:27 PM >2014-08-23 17:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3456af35] Autorecovering 1 storage domains >2014-08-23 17:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3456af35] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [7457ed3f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [7457ed3f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:30 PM >2014-08-23 17:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [755495aa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [755495aa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17fd086e >2014-08-23 17:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [755495aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:32:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [755495aa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17fd086e >2014-08-23 17:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [755495aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:32:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [755495aa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [755495aa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [7457ed3f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:32 PM >2014-08-23 17:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [70fb9422] Autorecovering 1 storage domains >2014-08-23 17:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [70fb9422] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [54843041] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [54843041] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:35 PM >2014-08-23 17:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2daa4486 >2014-08-23 17:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:37:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2daa4486 >2014-08-23 17:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:37:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [3b86e1cc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:37:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [54843041] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:37 PM >2014-08-23 17:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [2842e27b] Autorecovering 1 storage domains >2014-08-23 17:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [2842e27b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:40:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [cceb633] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [cceb633] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:40 PM >2014-08-23 17:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 304a49dc >2014-08-23 17:40:22,626 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update VMs/Templates Ovf. >2014-08-23 17:40:22,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update VM OVFs in Data Center Default >2014-08-23 17:40:22,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully updated VM OVFs in Data Center Default >2014-08-23 17:40:22,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to update template OVFs in Data Center Default >2014-08-23 17:40:22,630 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully updated templates OVFs in Data Center Default >2014-08-23 17:40:22,630 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 17:40:22,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [32d092d2] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 17:42:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:42:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 304a49dc >2014-08-23 17:42:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:42:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:42:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [6306b8d1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:42:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [cceb633] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:42 PM >2014-08-23 17:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [70fcfdf1] Autorecovering 1 storage domains >2014-08-23 17:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [70fcfdf1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [309ebe5d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [309ebe5d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:45 PM >2014-08-23 17:45:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:45:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 49cd24f3 >2014-08-23 17:47:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:47:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 49cd24f3 >2014-08-23 17:47:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:47:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:47:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [7de7ec82] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:47:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [309ebe5d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:47 PM >2014-08-23 17:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [2f105bb6] Autorecovering 1 storage domains >2014-08-23 17:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [2f105bb6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [36e64559] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [36e64559] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:50 PM >2014-08-23 17:50:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 60ee6529 >2014-08-23 17:51:18,389 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 17:52:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:52:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 60ee6529 >2014-08-23 17:52:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:52:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6fc1cb5c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:52:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [36e64559] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:52 PM >2014-08-23 17:54:05,012 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 17:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [6b899e0e] Autorecovering 1 storage domains >2014-08-23 17:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [6b899e0e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 17:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [24f2d558] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 17:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [24f2d558] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 5:55 PM >2014-08-23 17:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [5778d296] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 17:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [5778d296] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1f3453b4 >2014-08-23 17:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [5778d296] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 17:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [5778d296] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1f3453b4 >2014-08-23 17:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [5778d296] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 17:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [5778d296] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 17:57:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [5778d296] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 17:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [24f2d558] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 5:57 PM >2014-08-23 18:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [39292de6] Autorecovering 1 storage domains >2014-08-23 18:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [39292de6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:00:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [5f1ed4e6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:00:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [5f1ed4e6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:00 PM >2014-08-23 18:00:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [126d4c46] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:00:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [126d4c46] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 383dfe53 >2014-08-23 18:02:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [126d4c46] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:02:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [126d4c46] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 383dfe53 >2014-08-23 18:02:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [126d4c46] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:02:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [126d4c46] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:02:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [126d4c46] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:02:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [5f1ed4e6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:02 PM >2014-08-23 18:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [13a93e19] Autorecovering 1 storage domains >2014-08-23 18:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [13a93e19] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [b99fca7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [b99fca7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:05 PM >2014-08-23 18:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [2448de1e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [2448de1e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 12db0b26 >2014-08-23 18:06:58,024 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 18:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [2448de1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [2448de1e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 12db0b26 >2014-08-23 18:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [2448de1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [2448de1e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [2448de1e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:07:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [b99fca7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:07 PM >2014-08-23 18:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [4a63161d] Autorecovering 1 storage domains >2014-08-23 18:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [4a63161d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4410c264] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4410c264] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:10 PM >2014-08-23 18:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 216e703c >2014-08-23 18:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 216e703c >2014-08-23 18:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [25b8b5b5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [4410c264] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:12 PM >2014-08-23 18:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [309ebe5d] Autorecovering 1 storage domains >2014-08-23 18:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [309ebe5d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [7f328a49] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [7f328a49] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:15 PM >2014-08-23 18:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7d941997] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7d941997] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 684e6401 >2014-08-23 18:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [7d941997] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7d941997] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 684e6401 >2014-08-23 18:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [7d941997] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [7d941997] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7d941997] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:17:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [7f328a49] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:17 PM >2014-08-23 18:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [a575ba9] Autorecovering 1 storage domains >2014-08-23 18:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [a575ba9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [2934b930] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [2934b930] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:20 PM >2014-08-23 18:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [68845e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [68845e3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b16b0ee >2014-08-23 18:22:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [68845e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:22:05,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [68845e3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b16b0ee >2014-08-23 18:22:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [68845e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:22:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [68845e3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:22:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [68845e3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:22:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [2934b930] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:22 PM >2014-08-23 18:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [39c6cad7] Autorecovering 1 storage domains >2014-08-23 18:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [39c6cad7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [59f99da4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [59f99da4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:25 PM >2014-08-23 18:25:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:25:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 8bb6d0f >2014-08-23 18:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 8bb6d0f >2014-08-23 18:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [38efe0a2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [59f99da4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:27 PM >2014-08-23 18:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [4d99a2ca] Autorecovering 1 storage domains >2014-08-23 18:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [4d99a2ca] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [1ad144e1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [1ad144e1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:30 PM >2014-08-23 18:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [274f4a05] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [274f4a05] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 38138d92 >2014-08-23 18:32:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [274f4a05] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:32:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [274f4a05] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 38138d92 >2014-08-23 18:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [274f4a05] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:32:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [274f4a05] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [274f4a05] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:32:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [1ad144e1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:32 PM >2014-08-23 18:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [24f2d558] Autorecovering 1 storage domains >2014-08-23 18:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [24f2d558] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:35:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [765092f8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:35:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [765092f8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:35 PM >2014-08-23 18:35:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [54ce9105] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [54ce9105] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7db3e53d >2014-08-23 18:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [54ce9105] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:37:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [54ce9105] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7db3e53d >2014-08-23 18:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [54ce9105] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [54ce9105] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:37:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [54ce9105] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:37:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [765092f8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:37 PM >2014-08-23 18:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [1739690c] Autorecovering 1 storage domains >2014-08-23 18:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-88) [1739690c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [370dda9a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [370dda9a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:40 PM >2014-08-23 18:40:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:40:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c711d7c >2014-08-23 18:40:22,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Attempting to update VMs/Templates Ovf. >2014-08-23 18:40:22,633 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Attempting to update VM OVFs in Data Center Default >2014-08-23 18:40:22,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Successfully updated VM OVFs in Data Center Default >2014-08-23 18:40:22,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Attempting to update template OVFs in Data Center Default >2014-08-23 18:40:22,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Successfully updated templates OVFs in Data Center Default >2014-08-23 18:40:22,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 18:40:22,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) [b99fca7] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 18:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5c711d7c >2014-08-23 18:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [70a3e14a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-88) [370dda9a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:42 PM >2014-08-23 18:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [2803df71] Autorecovering 1 storage domains >2014-08-23 18:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [2803df71] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [505f2dab] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [505f2dab] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:45 PM >2014-08-23 18:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 75dcd797 >2014-08-23 18:46:21,529 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 18:47:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:47:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 75dcd797 >2014-08-23 18:47:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:47:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [4d2b4222] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:47:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [505f2dab] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:47 PM >2014-08-23 18:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [766ee87] Autorecovering 1 storage domains >2014-08-23 18:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [766ee87] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [58d0a34e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [58d0a34e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:50 PM >2014-08-23 18:50:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [26b8265a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:50:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [26b8265a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20c8ae15 >2014-08-23 18:51:09,532 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 18:52:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [26b8265a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:52:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [26b8265a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 20c8ae15 >2014-08-23 18:52:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [26b8265a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:52:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [26b8265a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [26b8265a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:52:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [58d0a34e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:52 PM >2014-08-23 18:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [56e4cb3b] Autorecovering 1 storage domains >2014-08-23 18:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [56e4cb3b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 18:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [318f6501] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 18:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [318f6501] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 6:55 PM >2014-08-23 18:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [7411178e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 18:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [7411178e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2088a191 >2014-08-23 18:57:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [7411178e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 18:57:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [7411178e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2088a191 >2014-08-23 18:57:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [7411178e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 18:57:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [7411178e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 18:57:05,134 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [7411178e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 18:57:05,134 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [318f6501] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 6:57 PM >2014-08-23 19:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [7d857dae] Autorecovering 1 storage domains >2014-08-23 19:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [7d857dae] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [6325da5e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [6325da5e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:00 PM >2014-08-23 19:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7497781c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7497781c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2740c32a >2014-08-23 19:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7497781c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:02:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7497781c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2740c32a >2014-08-23 19:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7497781c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:02:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [7497781c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7497781c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [6325da5e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:02 PM >2014-08-23 19:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [6791beb9] Autorecovering 1 storage domains >2014-08-23 19:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [6791beb9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3964ff0c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:05 PM >2014-08-23 19:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [4c37b178] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c37b178] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b817cf >2014-08-23 19:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [4c37b178] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c37b178] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4b817cf >2014-08-23 19:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [4c37b178] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [4c37b178] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [4c37b178] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:07:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3964ff0c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:07 PM >2014-08-23 19:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [38843a16] Autorecovering 1 storage domains >2014-08-23 19:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [38843a16] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [29055a64] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [29055a64] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:10 PM >2014-08-23 19:10:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:10:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 100f3c08 >2014-08-23 19:12:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:12:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 100f3c08 >2014-08-23 19:12:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:12:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:12:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [2fb2b960] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:12:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [29055a64] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:12 PM >2014-08-23 19:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [7457ed3f] Autorecovering 1 storage domains >2014-08-23 19:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [7457ed3f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e83e556] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e83e556] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:15 PM >2014-08-23 19:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [167225d7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [167225d7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65204428 >2014-08-23 19:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [167225d7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [167225d7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65204428 >2014-08-23 19:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [167225d7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [167225d7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [167225d7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:17:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e83e556] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:17 PM >2014-08-23 19:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [4b351b23] Autorecovering 1 storage domains >2014-08-23 19:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [4b351b23] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:20 PM >2014-08-23 19:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [34699d9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [34699d9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a1c06a6 >2014-08-23 19:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [34699d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [34699d9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3a1c06a6 >2014-08-23 19:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [34699d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [34699d9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [34699d9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:22 PM >2014-08-23 19:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [6891e298] Autorecovering 1 storage domains >2014-08-23 19:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [6891e298] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6dbe4ae] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6dbe4ae] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:25 PM >2014-08-23 19:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 64ffe1f4 >2014-08-23 19:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:27:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 64ffe1f4 >2014-08-23 19:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:27:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [5b3e614a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [6dbe4ae] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:27 PM >2014-08-23 19:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [6325da5e] Autorecovering 1 storage domains >2014-08-23 19:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [6325da5e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [3819e8cf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [3819e8cf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:30 PM >2014-08-23 19:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a079445 >2014-08-23 19:32:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:32:05,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7a079445 >2014-08-23 19:32:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:32:05,114 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:32:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [785b1ef3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:32:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [3819e8cf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:32 PM >2014-08-23 19:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [17963593] Autorecovering 1 storage domains >2014-08-23 19:35:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [17963593] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4eb41484] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4eb41484] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:35 PM >2014-08-23 19:35:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1146db6c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1146db6c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 25b5fb4e >2014-08-23 19:37:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1146db6c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:37:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1146db6c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 25b5fb4e >2014-08-23 19:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1146db6c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [1146db6c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:37:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1146db6c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:37:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4eb41484] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:37 PM >2014-08-23 19:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [6a89a416] Autorecovering 1 storage domains >2014-08-23 19:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [6a89a416] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [560dcf70] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [560dcf70] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:40 PM >2014-08-23 19:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [b55538a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [b55538a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b7fcd5e >2014-08-23 19:40:22,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Attempting to update VMs/Templates Ovf. >2014-08-23 19:40:22,638 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Attempting to update VM OVFs in Data Center Default >2014-08-23 19:40:22,639 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Successfully updated VM OVFs in Data Center Default >2014-08-23 19:40:22,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Attempting to update template OVFs in Data Center Default >2014-08-23 19:40:22,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Successfully updated templates OVFs in Data Center Default >2014-08-23 19:40:22,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 19:40:22,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 19:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [b55538a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [b55538a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b7fcd5e >2014-08-23 19:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [b55538a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [b55538a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [b55538a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:42:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [560dcf70] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:42 PM >2014-08-23 19:44:11,357 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 19:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7fca81f0] Autorecovering 1 storage domains >2014-08-23 19:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7fca81f0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6ccace8c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6ccace8c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:45 PM >2014-08-23 19:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: a8fa9e0 >2014-08-23 19:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:47:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: a8fa9e0 >2014-08-23 19:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:47:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1cb1daba] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6ccace8c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:47 PM >2014-08-23 19:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [7ab4a59a] Autorecovering 1 storage domains >2014-08-23 19:50:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [7ab4a59a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:50:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [9547d6f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [9547d6f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:50 PM >2014-08-23 19:50:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:50:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: bcbe674 >2014-08-23 19:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:52:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: bcbe674 >2014-08-23 19:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:52:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [1a1a2751] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:52:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [9547d6f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:52 PM >2014-08-23 19:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3e83e556] Autorecovering 1 storage domains >2014-08-23 19:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3e83e556] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 19:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [59b219] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 19:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [59b219] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 7:55 PM >2014-08-23 19:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [cf2b061] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 19:55:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [cf2b061] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1cc9dd6d >2014-08-23 19:57:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [cf2b061] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 19:57:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [cf2b061] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1cc9dd6d >2014-08-23 19:57:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [cf2b061] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 19:57:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [cf2b061] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 19:57:05,101 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [cf2b061] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 19:57:05,101 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [59b219] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 7:57 PM >2014-08-23 20:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [3ae60c06] Autorecovering 1 storage domains >2014-08-23 20:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [3ae60c06] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [6ac1a054] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [6ac1a054] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:00 PM >2014-08-23 20:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [5e638edc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [5e638edc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 14135d0c >2014-08-23 20:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [5e638edc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [5e638edc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 14135d0c >2014-08-23 20:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [5e638edc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [5e638edc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [5e638edc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [6ac1a054] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:02 PM >2014-08-23 20:04:23,455 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 20:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [3c0c174f] Autorecovering 1 storage domains >2014-08-23 20:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [3c0c174f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [55c4bb67] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [55c4bb67] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:05 PM >2014-08-23 20:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1fb29fc1 >2014-08-23 20:07:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:07:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1fb29fc1 >2014-08-23 20:07:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:07:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [3e7402e3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:07:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [55c4bb67] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:07 PM >2014-08-23 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [31ebdc75] Autorecovering 1 storage domains >2014-08-23 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [31ebdc75] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [243fc42d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [243fc42d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:10 PM >2014-08-23 20:10:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [53229ca6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:10:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [53229ca6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 359ee3f4 >2014-08-23 20:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [53229ca6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:12:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [53229ca6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 359ee3f4 >2014-08-23 20:12:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [53229ca6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [53229ca6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:12:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [53229ca6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:12:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [243fc42d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:12 PM >2014-08-23 20:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [6de86979] Autorecovering 1 storage domains >2014-08-23 20:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [6de86979] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [5d92d0c7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [5d92d0c7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:15 PM >2014-08-23 20:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 25eccd3 >2014-08-23 20:17:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:17:05,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 25eccd3 >2014-08-23 20:17:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:17:05,126 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:17:05,130 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [b04c9f4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:17:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [5d92d0c7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:17 PM >2014-08-23 20:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [2cf8cb7e] Autorecovering 1 storage domains >2014-08-23 20:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [2cf8cb7e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [68eb4e03] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:20 PM >2014-08-23 20:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [58710669] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [58710669] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 231b5ca >2014-08-23 20:22:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [58710669] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:22:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [58710669] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 231b5ca >2014-08-23 20:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [58710669] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:22:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [58710669] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [58710669] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:22:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [68eb4e03] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:22 PM >2014-08-23 20:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [5e776b5c] Autorecovering 1 storage domains >2014-08-23 20:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [5e776b5c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7cdec9e2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7cdec9e2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:25 PM >2014-08-23 20:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [46e596be] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [46e596be] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 177be019 >2014-08-23 20:27:05,163 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [46e596be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:27:05,164 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [46e596be] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 177be019 >2014-08-23 20:27:05,165 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [46e596be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:27:05,165 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [46e596be] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:27:05,169 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [46e596be] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:27:05,169 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7cdec9e2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:27 PM >2014-08-23 20:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [57dbfef4] Autorecovering 1 storage domains >2014-08-23 20:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [57dbfef4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:30:00,005 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [6fd11cf3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:30:00,005 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [6fd11cf3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:30 PM >2014-08-23 20:30:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [59966500] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:30:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [59966500] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 54cfbab >2014-08-23 20:32:05,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [59966500] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:32:05,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [59966500] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 54cfbab >2014-08-23 20:32:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [59966500] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:32:05,142 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [59966500] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:32:05,146 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [59966500] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:32:05,147 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [6fd11cf3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:32 PM >2014-08-23 20:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [63c317a7] Autorecovering 1 storage domains >2014-08-23 20:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [63c317a7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [cee9945] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [cee9945] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:35 PM >2014-08-23 20:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:35:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50c82ee5 >2014-08-23 20:37:05,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:37:05,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 50c82ee5 >2014-08-23 20:37:05,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:37:05,139 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:37:05,144 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2412a9e4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:37:05,145 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [cee9945] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:37 PM >2014-08-23 20:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [6e1037a6] Autorecovering 1 storage domains >2014-08-23 20:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [6e1037a6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [12855e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [12855e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:40 PM >2014-08-23 20:40:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41a7e060 >2014-08-23 20:40:22,643 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Attempting to update VMs/Templates Ovf. >2014-08-23 20:40:22,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Attempting to update VM OVFs in Data Center Default >2014-08-23 20:40:22,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Successfully updated VM OVFs in Data Center Default >2014-08-23 20:40:22,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Attempting to update template OVFs in Data Center Default >2014-08-23 20:40:22,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Successfully updated templates OVFs in Data Center Default >2014-08-23 20:40:22,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 20:40:22,649 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) [727792e] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 20:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:42:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41a7e060 >2014-08-23 20:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [a96e3ba] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:42:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [12855e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:42 PM >2014-08-23 20:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [55c4bb67] Autorecovering 1 storage domains >2014-08-23 20:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [55c4bb67] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [4f72ed84] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [4f72ed84] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:45 PM >2014-08-23 20:45:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [3a861de5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:45:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [3a861de5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 437cdc6a >2014-08-23 20:47:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [3a861de5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:47:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [3a861de5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 437cdc6a >2014-08-23 20:47:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [3a861de5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:47:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [3a861de5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:47:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [3a861de5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:47:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [4f72ed84] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:47 PM >2014-08-23 20:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [2362bc5] Autorecovering 1 storage domains >2014-08-23 20:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [2362bc5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [57e675c4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [57e675c4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:50 PM >2014-08-23 20:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47d1d06a >2014-08-23 20:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:52:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 47d1d06a >2014-08-23 20:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:52:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7f8ef2e4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:52:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [57e675c4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:52 PM >2014-08-23 20:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [1a433c8b] Autorecovering 1 storage domains >2014-08-23 20:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [1a433c8b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 20:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [40c43ee8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 20:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [40c43ee8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 8:55 PM >2014-08-23 20:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [57d852f0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 20:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [57d852f0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: de0b8b0 >2014-08-23 20:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [57d852f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 20:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [57d852f0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: de0b8b0 >2014-08-23 20:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [57d852f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 20:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [57d852f0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 20:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [57d852f0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 20:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [40c43ee8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 8:57 PM >2014-08-23 21:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [37200f4] Autorecovering 1 storage domains >2014-08-23 21:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [37200f4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [35535460] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [35535460] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:00 PM >2014-08-23 21:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41de1189 >2014-08-23 21:02:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:02:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41de1189 >2014-08-23 21:02:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:02:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:02:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [18b0aca5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:02:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [35535460] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:02 PM >2014-08-23 21:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [232c88c6] Autorecovering 1 storage domains >2014-08-23 21:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [232c88c6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5ba03032] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5ba03032] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:05 PM >2014-08-23 21:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [614b26eb] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:05:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [614b26eb] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33cc7744 >2014-08-23 21:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [614b26eb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [614b26eb] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33cc7744 >2014-08-23 21:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [614b26eb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [614b26eb] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [614b26eb] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:07:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [5ba03032] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:07 PM >2014-08-23 21:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [4410c264] Autorecovering 1 storage domains >2014-08-23 21:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [4410c264] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [71f7478e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [71f7478e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:10 PM >2014-08-23 21:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b3f6731 >2014-08-23 21:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4b3f6731 >2014-08-23 21:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [5f8cc317] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:12:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [71f7478e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:12 PM >2014-08-23 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [7f328a49] Autorecovering 1 storage domains >2014-08-23 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [7f328a49] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [6b866323] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [6b866323] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:15 PM >2014-08-23 21:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1b872676] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1b872676] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5a605f8e >2014-08-23 21:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1b872676] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:17:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1b872676] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5a605f8e >2014-08-23 21:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1b872676] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [1b872676] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:17:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1b872676] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:17:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [6b866323] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:17 PM >2014-08-23 21:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [59cb3676] Autorecovering 1 storage domains >2014-08-23 21:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [59cb3676] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [2a51ef0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [2a51ef0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:20 PM >2014-08-23 21:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e17345d >2014-08-23 21:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:22:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e17345d >2014-08-23 21:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [2ddc7539] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:22:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [2a51ef0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:22 PM >2014-08-23 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [4126de99] Autorecovering 1 storage domains >2014-08-23 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [4126de99] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1f7a3933] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1f7a3933] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:25 PM >2014-08-23 21:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e15c803 >2014-08-23 21:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6e15c803 >2014-08-23 21:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:27:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [4e8bf89f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:27:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1f7a3933] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:27 PM >2014-08-23 21:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [5105d10a] Autorecovering 1 storage domains >2014-08-23 21:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [5105d10a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [553c9fce] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [553c9fce] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:30 PM >2014-08-23 21:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [10e0f65] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [10e0f65] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d09e55c >2014-08-23 21:32:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [10e0f65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:32:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [10e0f65] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d09e55c >2014-08-23 21:32:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [10e0f65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:32:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [10e0f65] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:32:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [10e0f65] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:32:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [553c9fce] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:32 PM >2014-08-23 21:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [59663ab] Autorecovering 1 storage domains >2014-08-23 21:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [59663ab] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [16a56e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [16a56e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:35 PM >2014-08-23 21:35:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [490d059e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:35:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [490d059e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19ca16ef >2014-08-23 21:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [490d059e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:37:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [490d059e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 19ca16ef >2014-08-23 21:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [490d059e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [490d059e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:37:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [490d059e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:37:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [16a56e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:37 PM >2014-08-23 21:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [3d8aa5df] Autorecovering 1 storage domains >2014-08-23 21:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [3d8aa5df] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [c3d9f25] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:40:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [c3d9f25] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:40 PM >2014-08-23 21:40:00,025 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [33809092] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:40:00,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [33809092] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1e0415ff >2014-08-23 21:40:22,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Attempting to update VMs/Templates Ovf. >2014-08-23 21:40:22,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Attempting to update VM OVFs in Data Center Default >2014-08-23 21:40:22,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Successfully updated VM OVFs in Data Center Default >2014-08-23 21:40:22,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Attempting to update template OVFs in Data Center Default >2014-08-23 21:40:22,654 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Successfully updated templates OVFs in Data Center Default >2014-08-23 21:40:22,654 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 21:40:22,655 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) [13250d88] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 21:42:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [33809092] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:42:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [33809092] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1e0415ff >2014-08-23 21:42:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [33809092] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [33809092] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:42:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [33809092] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:42:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [c3d9f25] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:42 PM >2014-08-23 21:43:08,495 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 21:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [9547d6f] Autorecovering 1 storage domains >2014-08-23 21:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [9547d6f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:45:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [334b864b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:45:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [334b864b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:45 PM >2014-08-23 21:45:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:45:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47560cbe >2014-08-23 21:47:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:47:05,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 47560cbe >2014-08-23 21:47:05,146 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:47:05,146 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:47:05,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [5e9d8e88] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:47:05,150 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [334b864b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:47 PM >2014-08-23 21:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [71f7478e] Autorecovering 1 storage domains >2014-08-23 21:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [71f7478e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [3153303c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [3153303c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:50 PM >2014-08-23 21:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6136a4d5 >2014-08-23 21:52:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:52:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6136a4d5 >2014-08-23 21:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:52:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [59ab5a58] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:52:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [3153303c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:52 PM >2014-08-23 21:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [243fc42d] Autorecovering 1 storage domains >2014-08-23 21:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [243fc42d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 21:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [5892375] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 21:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [5892375] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 9:55 PM >2014-08-23 21:55:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [39835ca] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 21:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [39835ca] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1752f893 >2014-08-23 21:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [39835ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 21:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [39835ca] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1752f893 >2014-08-23 21:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [39835ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 21:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [39835ca] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 21:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [39835ca] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 21:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [5892375] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 9:57 PM >2014-08-23 22:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [2a51ef0] Autorecovering 1 storage domains >2014-08-23 22:00:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [2a51ef0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5d3ad89b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5d3ad89b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:00 PM >2014-08-23 22:00:00,025 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [4b30e068] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:00:00,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4b30e068] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b337889 >2014-08-23 22:02:05,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [4b30e068] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:02:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [4b30e068] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5b337889 >2014-08-23 22:02:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [4b30e068] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:02:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [4b30e068] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:02:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [4b30e068] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:02:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5d3ad89b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:02 PM >2014-08-23 22:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [6cd6b3ab] Autorecovering 1 storage domains >2014-08-23 22:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [6cd6b3ab] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [4acce1d2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [4acce1d2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:05 PM >2014-08-23 22:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [b5e518d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [b5e518d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 483cba54 >2014-08-23 22:05:52,059 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 22:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [b5e518d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:07:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [b5e518d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 483cba54 >2014-08-23 22:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [b5e518d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:07:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [b5e518d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [b5e518d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:07:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [4acce1d2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:07 PM >2014-08-23 22:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [c3d9f25] Autorecovering 1 storage domains >2014-08-23 22:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [c3d9f25] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [5356c80f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [5356c80f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:10 PM >2014-08-23 22:10:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5639ed01] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:10:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5639ed01] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f75536 >2014-08-23 22:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5639ed01] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5639ed01] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f75536 >2014-08-23 22:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5639ed01] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [5639ed01] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5639ed01] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [5356c80f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:12 PM >2014-08-23 22:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [43c289a6] Autorecovering 1 storage domains >2014-08-23 22:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [43c289a6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [1f9f2f6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [1f9f2f6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:15 PM >2014-08-23 22:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [48c8979f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [48c8979f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 42757d6d >2014-08-23 22:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [48c8979f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:17:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [48c8979f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 42757d6d >2014-08-23 22:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [48c8979f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [48c8979f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [48c8979f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:17:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [1f9f2f6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:17 PM >2014-08-23 22:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [cee9945] Autorecovering 1 storage domains >2014-08-23 22:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [cee9945] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [103035d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [103035d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:20 PM >2014-08-23 22:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 249bd49f >2014-08-23 22:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:22:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 249bd49f >2014-08-23 22:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:22:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7f829bfa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:22:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [103035d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:22 PM >2014-08-23 22:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [12855e] Autorecovering 1 storage domains >2014-08-23 22:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [12855e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [773b374b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [773b374b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:25 PM >2014-08-23 22:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [65983f1b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [65983f1b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 62b7b02b >2014-08-23 22:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [65983f1b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [65983f1b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 62b7b02b >2014-08-23 22:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [65983f1b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [65983f1b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [65983f1b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [773b374b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:27 PM >2014-08-23 22:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [7cfa1f85] Autorecovering 1 storage domains >2014-08-23 22:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [7cfa1f85] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [430454bf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [430454bf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:30 PM >2014-08-23 22:30:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [b67177e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:30:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [b67177e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79563246 >2014-08-23 22:32:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [b67177e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:32:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [b67177e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79563246 >2014-08-23 22:32:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [b67177e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:32:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [b67177e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:32:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [b67177e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:32:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [430454bf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:32 PM >2014-08-23 22:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [57e675c4] Autorecovering 1 storage domains >2014-08-23 22:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [57e675c4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [6d210993] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [6d210993] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:35 PM >2014-08-23 22:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [33d34823] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [33d34823] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 102b0647 >2014-08-23 22:37:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [33d34823] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:37:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [33d34823] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 102b0647 >2014-08-23 22:37:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [33d34823] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:37:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [33d34823] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:37:05,137 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [33d34823] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:37:05,137 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [6d210993] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:37 PM >2014-08-23 22:38:11,387 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 22:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [5356c80f] Autorecovering 1 storage domains >2014-08-23 22:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [5356c80f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [411da325] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [411da325] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:40 PM >2014-08-23 22:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 72508de7 >2014-08-23 22:40:22,656 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update VMs/Templates Ovf. >2014-08-23 22:40:22,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update VM OVFs in Data Center Default >2014-08-23 22:40:22,659 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully updated VM OVFs in Data Center Default >2014-08-23 22:40:22,659 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to update template OVFs in Data Center Default >2014-08-23 22:40:22,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully updated templates OVFs in Data Center Default >2014-08-23 22:40:22,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 22:40:22,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 22:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 72508de7 >2014-08-23 22:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:42:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [7e3ab64e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:42:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [411da325] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:42 PM >2014-08-23 22:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [35535460] Autorecovering 1 storage domains >2014-08-23 22:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-25) [35535460] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [7279bcb0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [7279bcb0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:45 PM >2014-08-23 22:45:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:45:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 411fd18c >2014-08-23 22:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:47:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 411fd18c >2014-08-23 22:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:47:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [74e79d8b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-25) [7279bcb0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:47 PM >2014-08-23 22:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [40c43ee8] Autorecovering 1 storage domains >2014-08-23 22:50:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [40c43ee8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:50:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [798a4dae] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:50:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [798a4dae] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:50 PM >2014-08-23 22:50:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:50:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 281fdc9f >2014-08-23 22:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 281fdc9f >2014-08-23 22:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:52:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5a4d9f95] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:52:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [798a4dae] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:52 PM >2014-08-23 22:53:35,718 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 22:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [23e16c9] Autorecovering 1 storage domains >2014-08-23 22:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [23e16c9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 22:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [1df7d7f0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 22:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [1df7d7f0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 10:55 PM >2014-08-23 22:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 22:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bc4561c >2014-08-23 22:55:36,912 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 22:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 22:57:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7bc4561c >2014-08-23 22:57:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 22:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 22:57:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [3bd0007d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 22:57:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [1df7d7f0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 10:57 PM >2014-08-23 23:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [6de5c4a1] Autorecovering 1 storage domains >2014-08-23 23:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [6de5c4a1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [45f8fbb9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [45f8fbb9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:00 PM >2014-08-23 23:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [c36bcac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [c36bcac] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2818960a >2014-08-23 23:02:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [c36bcac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:02:05,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [c36bcac] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2818960a >2014-08-23 23:02:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [c36bcac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:02:05,117 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [c36bcac] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:02:05,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [c36bcac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:02:05,122 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [45f8fbb9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:02 PM >2014-08-23 23:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [45980cfb] Autorecovering 1 storage domains >2014-08-23 23:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [45980cfb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74455e77] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74455e77] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:05 PM >2014-08-23 23:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 53a0a093 >2014-08-23 23:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 53a0a093 >2014-08-23 23:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [6e6d048e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74455e77] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:07 PM >2014-08-23 23:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [5636814b] Autorecovering 1 storage domains >2014-08-23 23:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [5636814b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [170d437b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [170d437b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:10 PM >2014-08-23 23:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [ed64c20] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [ed64c20] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 534523ff >2014-08-23 23:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [ed64c20] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [ed64c20] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 534523ff >2014-08-23 23:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [ed64c20] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:12:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [ed64c20] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [ed64c20] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [170d437b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:12 PM >2014-08-23 23:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [5d92d0c7] Autorecovering 1 storage domains >2014-08-23 23:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [5d92d0c7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [8c6b263] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [8c6b263] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:15 PM >2014-08-23 23:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [18767181] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [18767181] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22024738 >2014-08-23 23:17:05,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [18767181] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:17:05,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [18767181] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 22024738 >2014-08-23 23:17:05,148 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [18767181] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:17:05,148 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [18767181] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:17:05,151 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [18767181] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:17:05,151 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [8c6b263] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:17 PM >2014-08-23 23:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [318f6501] Autorecovering 1 storage domains >2014-08-23 23:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [318f6501] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [798ebaa2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [798ebaa2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:20 PM >2014-08-23 23:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [490a0a77] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [490a0a77] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 845158c >2014-08-23 23:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [490a0a77] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:22:05,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [490a0a77] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 845158c >2014-08-23 23:22:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [490a0a77] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:22:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [490a0a77] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:22:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [490a0a77] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:22:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [798ebaa2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:22 PM >2014-08-23 23:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [6f03474c] Autorecovering 1 storage domains >2014-08-23 23:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [6f03474c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [125c7d8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [125c7d8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:25 PM >2014-08-23 23:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [5322993c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [5322993c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 63e2604e >2014-08-23 23:27:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [5322993c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:27:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [5322993c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 63e2604e >2014-08-23 23:27:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [5322993c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:27:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [5322993c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:27:05,130 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [5322993c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:27:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [125c7d8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:27 PM >2014-08-23 23:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [5cd89135] Autorecovering 1 storage domains >2014-08-23 23:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [5cd89135] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [145b7090] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [145b7090] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:30 PM >2014-08-23 23:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [2526355a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [2526355a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5f8f27ee >2014-08-23 23:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [2526355a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [2526355a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5f8f27ee >2014-08-23 23:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [2526355a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [2526355a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [2526355a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [145b7090] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:32 PM >2014-08-23 23:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [4716763e] Autorecovering 1 storage domains >2014-08-23 23:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [4716763e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [e8bfc57] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [e8bfc57] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:35 PM >2014-08-23 23:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 681e83c4 >2014-08-23 23:36:01,312 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-23 23:37:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:37:05,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 681e83c4 >2014-08-23 23:37:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:37:05,126 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:37:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [9fd9e5d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:37:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [e8bfc57] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:37 PM >2014-08-23 23:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [1425440d] Autorecovering 1 storage domains >2014-08-23 23:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [1425440d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [5f5e6e3c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [5f5e6e3c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:40 PM >2014-08-23 23:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [7e700c87] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7e700c87] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 530e805f >2014-08-23 23:40:22,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Attempting to update VMs/Templates Ovf. >2014-08-23 23:40:22,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Attempting to update VM OVFs in Data Center Default >2014-08-23 23:40:22,664 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Successfully updated VM OVFs in Data Center Default >2014-08-23 23:40:22,664 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Attempting to update template OVFs in Data Center Default >2014-08-23 23:40:22,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Successfully updated templates OVFs in Data Center Default >2014-08-23 23:40:22,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-23 23:40:22,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-23 23:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [7e700c87] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:42:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7e700c87] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 530e805f >2014-08-23 23:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [7e700c87] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:42:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [7e700c87] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [7e700c87] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:42:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [5f5e6e3c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:42 PM >2014-08-23 23:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [5d3ad89b] Autorecovering 1 storage domains >2014-08-23 23:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [5d3ad89b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [766c2500] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [766c2500] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:45 PM >2014-08-23 23:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3125e660] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3125e660] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f7cd61b >2014-08-23 23:47:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3125e660] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:47:05,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3125e660] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3f7cd61b >2014-08-23 23:47:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3125e660] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:47:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [3125e660] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:47:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3125e660] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:47:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [766c2500] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:47 PM >2014-08-23 23:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [213d2613] Autorecovering 1 storage domains >2014-08-23 23:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [213d2613] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [3edefae2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [3edefae2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:50 PM >2014-08-23 23:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [7bed7679] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [7bed7679] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4175f1f5 >2014-08-23 23:52:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [7bed7679] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:52:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [7bed7679] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4175f1f5 >2014-08-23 23:52:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [7bed7679] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:52:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [7bed7679] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:52:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [7bed7679] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:52:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [3edefae2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:52 PM >2014-08-23 23:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [59f99da4] Autorecovering 1 storage domains >2014-08-23 23:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [59f99da4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-23 23:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d9fd3d3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-23 23:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d9fd3d3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/23/14 11:55 PM >2014-08-23 23:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-23 23:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 347d99 >2014-08-23 23:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-23 23:57:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 347d99 >2014-08-23 23:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-23 23:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-23 23:57:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [d45f0e8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-23 23:57:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d9fd3d3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/23/14 11:57 PM >2014-08-24 00:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Autorecovering 1 storage domains >2014-08-24 00:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [1cb553ca] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [6cf6f1a0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [6cf6f1a0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:00 AM >2014-08-24 00:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [55b51ece] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [55b51ece] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a16692f >2014-08-24 00:02:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [55b51ece] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:02:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [55b51ece] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4a16692f >2014-08-24 00:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [55b51ece] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:02:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [55b51ece] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [55b51ece] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:02:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [6cf6f1a0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:02 AM >2014-08-24 00:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [5ba03032] Autorecovering 1 storage domains >2014-08-24 00:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [5ba03032] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1813ff46] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1813ff46] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:05 AM >2014-08-24 00:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 763c2d41 >2014-08-24 00:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 763c2d41 >2014-08-24 00:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [5f5297b2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:07:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [1813ff46] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:07 AM >2014-08-24 00:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [727792e] Autorecovering 1 storage domains >2014-08-24 00:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [727792e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [18a23936] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [18a23936] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:10 AM >2014-08-24 00:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [19d35658] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [19d35658] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 24a50e7c >2014-08-24 00:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [19d35658] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:12:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [19d35658] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 24a50e7c >2014-08-24 00:12:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [19d35658] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [19d35658] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:12:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [19d35658] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:12:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [18a23936] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:12 AM >2014-08-24 00:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [6ac1a054] Autorecovering 1 storage domains >2014-08-24 00:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [6ac1a054] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e170dc5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e170dc5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:15 AM >2014-08-24 00:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [c70fc91] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [c70fc91] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 784dc3e5 >2014-08-24 00:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [c70fc91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [c70fc91] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 784dc3e5 >2014-08-24 00:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [c70fc91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [c70fc91] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [c70fc91] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e170dc5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:17 AM >2014-08-24 00:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [1dd9b94] Autorecovering 1 storage domains >2014-08-24 00:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [1dd9b94] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [4ed27de] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [4ed27de] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:20 AM >2014-08-24 00:20:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:20:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4970b925 >2014-08-24 00:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:22:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4970b925 >2014-08-24 00:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [4a3d6371] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [4ed27de] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:22 AM >2014-08-24 00:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [d9fd3d3] Autorecovering 1 storage domains >2014-08-24 00:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [d9fd3d3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d805a56] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d805a56] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:25 AM >2014-08-24 00:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [61018f0d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [61018f0d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69387144 >2014-08-24 00:27:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [61018f0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:27:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [61018f0d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69387144 >2014-08-24 00:27:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [61018f0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:27:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [61018f0d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:27:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [61018f0d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:27:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [d805a56] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:27 AM >2014-08-24 00:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [40b8e60e] Autorecovering 1 storage domains >2014-08-24 00:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [40b8e60e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4f7fdbeb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4f7fdbeb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:30 AM >2014-08-24 00:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:30:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a44f1bd >2014-08-24 00:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:32:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3a44f1bd >2014-08-24 00:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:32:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6bd17b0d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:32:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4f7fdbeb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:32 AM >2014-08-24 00:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [2979ea3f] Autorecovering 1 storage domains >2014-08-24 00:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [2979ea3f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [aa021e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [aa021e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:35 AM >2014-08-24 00:35:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [29289c7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [29289c7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b5d1108 >2014-08-24 00:37:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [29289c7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:37:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [29289c7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4b5d1108 >2014-08-24 00:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [29289c7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [29289c7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:37:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [29289c7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:37:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [aa021e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:37 AM >2014-08-24 00:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [7f76075] Autorecovering 1 storage domains >2014-08-24 00:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [7f76075] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7e54b4c9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7e54b4c9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:40 AM >2014-08-24 00:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5b08017c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5b08017c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c5c0154 >2014-08-24 00:40:22,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Attempting to update VMs/Templates Ovf. >2014-08-24 00:40:22,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Attempting to update VM OVFs in Data Center Default >2014-08-24 00:40:22,669 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Successfully updated VM OVFs in Data Center Default >2014-08-24 00:40:22,670 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Attempting to update template OVFs in Data Center Default >2014-08-24 00:40:22,671 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Successfully updated templates OVFs in Data Center Default >2014-08-24 00:40:22,671 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 00:40:22,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 00:42:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5b08017c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:42:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [5b08017c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5c5c0154 >2014-08-24 00:42:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [5b08017c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:42:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [5b08017c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:42:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [5b08017c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:42:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [7e54b4c9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:42 AM >2014-08-24 00:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [45f8fbb9] Autorecovering 1 storage domains >2014-08-24 00:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [45f8fbb9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [1967022f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [1967022f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:45 AM >2014-08-24 00:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [78ab4608] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:45:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [78ab4608] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7ddb23d4 >2014-08-24 00:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [78ab4608] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:47:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [78ab4608] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7ddb23d4 >2014-08-24 00:47:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [78ab4608] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:47:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [78ab4608] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:47:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [78ab4608] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:47:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [1967022f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:47 AM >2014-08-24 00:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [553c9fce] Autorecovering 1 storage domains >2014-08-24 00:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [553c9fce] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cae3cce] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cae3cce] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:50 AM >2014-08-24 00:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 306175b0 >2014-08-24 00:52:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:52:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 306175b0 >2014-08-24 00:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:52:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:52:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [521dc8b7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:52:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4cae3cce] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:52 AM >2014-08-24 00:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [2e170dc5] Autorecovering 1 storage domains >2014-08-24 00:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [2e170dc5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 00:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ceff859] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 00:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ceff859] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:55 AM >2014-08-24 00:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 00:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 72122e53 >2014-08-24 00:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 00:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 72122e53 >2014-08-24 00:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 00:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 00:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [77aa1b84] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 00:57:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [3ceff859] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:57 AM >2014-08-24 00:57:50,342 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 01:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [68a89df3] Autorecovering 1 storage domains >2014-08-24 01:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [68a89df3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3f9b888c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3f9b888c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:00 AM >2014-08-24 01:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [5f91dd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5f91dd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 214cf7d6 >2014-08-24 01:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [5f91dd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [5f91dd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 214cf7d6 >2014-08-24 01:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [5f91dd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [5f91dd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [5f91dd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3f9b888c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:02 AM >2014-08-24 01:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [170d437b] Autorecovering 1 storage domains >2014-08-24 01:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [170d437b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [22e09fa5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [22e09fa5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:05 AM >2014-08-24 01:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 243aea >2014-08-24 01:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 243aea >2014-08-24 01:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4bfd48b2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [22e09fa5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:07 AM >2014-08-24 01:08:41,796 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 01:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [3819e8cf] Autorecovering 1 storage domains >2014-08-24 01:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [3819e8cf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [611e9da0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [611e9da0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:10 AM >2014-08-24 01:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 634d7d44 >2014-08-24 01:12:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:12:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 634d7d44 >2014-08-24 01:12:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:12:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:12:05,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [17a76c5a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:12:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [611e9da0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:12 AM >2014-08-24 01:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [59354db7] Autorecovering 1 storage domains >2014-08-24 01:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [59354db7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [37bc57e0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [37bc57e0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:15 AM >2014-08-24 01:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [13de4e31] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [13de4e31] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6bf8d02 >2014-08-24 01:17:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [13de4e31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:17:05,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [13de4e31] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6bf8d02 >2014-08-24 01:17:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [13de4e31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:17:05,144 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [13de4e31] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:17:05,149 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [13de4e31] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:17:05,149 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [37bc57e0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:17 AM >2014-08-24 01:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4cae3cce] Autorecovering 1 storage domains >2014-08-24 01:20:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4cae3cce] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [641e8d79] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:20:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [641e8d79] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:20 AM >2014-08-24 01:20:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [38cefa09] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [38cefa09] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2bd46d14 >2014-08-24 01:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [38cefa09] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [38cefa09] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2bd46d14 >2014-08-24 01:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [38cefa09] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [38cefa09] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [38cefa09] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [641e8d79] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:22 AM >2014-08-24 01:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [145b7090] Autorecovering 1 storage domains >2014-08-24 01:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [145b7090] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [78c1433e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [78c1433e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:25 AM >2014-08-24 01:25:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:25:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 48de2efc >2014-08-24 01:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:27:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 48de2efc >2014-08-24 01:27:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:27:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [1e48fb82] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [78c1433e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:27 AM >2014-08-24 01:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [430454bf] Autorecovering 1 storage domains >2014-08-24 01:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [430454bf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [5b69f3dc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [5b69f3dc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:30 AM >2014-08-24 01:30:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:30:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 63834ac >2014-08-24 01:32:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:32:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 63834ac >2014-08-24 01:32:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:32:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:32:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [6bf90a7c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:32:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [5b69f3dc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:32 AM >2014-08-24 01:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [3c0f91a7] Autorecovering 1 storage domains >2014-08-24 01:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [3c0f91a7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [14cf7f75] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [14cf7f75] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:35 AM >2014-08-24 01:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [493be54f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [493be54f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 8792edc >2014-08-24 01:37:05,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [493be54f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:37:05,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [493be54f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 8792edc >2014-08-24 01:37:05,146 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [493be54f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:37:05,146 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [493be54f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:37:05,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [493be54f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:37:05,151 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [14cf7f75] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:37 AM >2014-08-24 01:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [766c2500] Autorecovering 1 storage domains >2014-08-24 01:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [766c2500] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5df2a436] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5df2a436] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:40 AM >2014-08-24 01:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7eafc30a >2014-08-24 01:40:22,673 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Attempting to update VMs/Templates Ovf. >2014-08-24 01:40:22,675 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Attempting to update VM OVFs in Data Center Default >2014-08-24 01:40:22,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Successfully updated VM OVFs in Data Center Default >2014-08-24 01:40:22,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Attempting to update template OVFs in Data Center Default >2014-08-24 01:40:22,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Successfully updated templates OVFs in Data Center Default >2014-08-24 01:40:22,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 01:40:22,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [6d210993] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 01:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:42:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7eafc30a >2014-08-24 01:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:42:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [41ecd96d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:42:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [5df2a436] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:42 AM >2014-08-24 01:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [22e09fa5] Autorecovering 1 storage domains >2014-08-24 01:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [22e09fa5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [1ec26128] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [1ec26128] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:45 AM >2014-08-24 01:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [72394804] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [72394804] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 93039fa >2014-08-24 01:47:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [72394804] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:47:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [72394804] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 93039fa >2014-08-24 01:47:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [72394804] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:47:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [72394804] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:47:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [72394804] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:47:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [1ec26128] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:47 AM >2014-08-24 01:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Autorecovering 1 storage domains >2014-08-24 01:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [3964ff0c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [521e71e5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [521e71e5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:50 AM >2014-08-24 01:50:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [3164f93] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [3164f93] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4cfe8ae3 >2014-08-24 01:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [3164f93] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [3164f93] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4cfe8ae3 >2014-08-24 01:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [3164f93] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [3164f93] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:52:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [3164f93] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:52:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [521e71e5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:52 AM >2014-08-24 01:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [37bc57e0] Autorecovering 1 storage domains >2014-08-24 01:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [37bc57e0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 01:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [73794435] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 01:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [73794435] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:55 AM >2014-08-24 01:55:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [46526a4f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 01:55:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [46526a4f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1a6e8df6 >2014-08-24 01:57:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [46526a4f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 01:57:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [46526a4f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1a6e8df6 >2014-08-24 01:57:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [46526a4f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 01:57:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [46526a4f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 01:57:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [46526a4f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 01:57:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [73794435] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:57 AM >2014-08-24 02:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [798a4dae] Autorecovering 1 storage domains >2014-08-24 02:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [798a4dae] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [16635780] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [16635780] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:00 AM >2014-08-24 02:00:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [169565e2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [169565e2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 57fc6e75 >2014-08-24 02:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [169565e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [169565e2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 57fc6e75 >2014-08-24 02:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [169565e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [169565e2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [169565e2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:02:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [16635780] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:02 AM >2014-08-24 02:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [78c1433e] Autorecovering 1 storage domains >2014-08-24 02:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [78c1433e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [38215689] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [38215689] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:05 AM >2014-08-24 02:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 607a2643 >2014-08-24 02:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 607a2643 >2014-08-24 02:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [62ba60f0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:07:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [38215689] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:07 AM >2014-08-24 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [4eb41484] Autorecovering 1 storage domains >2014-08-24 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [4eb41484] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [1c27fc25] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [1c27fc25] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:10 AM >2014-08-24 02:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [386f142c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [386f142c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3a50a07d >2014-08-24 02:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [386f142c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:12:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [386f142c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3a50a07d >2014-08-24 02:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [386f142c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:12:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [386f142c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [386f142c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:12:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [1c27fc25] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:12 AM >2014-08-24 02:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [638e8a2a] Autorecovering 1 storage domains >2014-08-24 02:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [638e8a2a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [f23b0de] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [f23b0de] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:15 AM >2014-08-24 02:15:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:15:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: bacdc06 >2014-08-24 02:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: bacdc06 >2014-08-24 02:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2becf2b4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [f23b0de] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:17 AM >2014-08-24 02:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [798ebaa2] Autorecovering 1 storage domains >2014-08-24 02:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [798ebaa2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [55e49605] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [55e49605] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:20 AM >2014-08-24 02:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [64bf257f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [64bf257f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6bda8105 >2014-08-24 02:21:41,061 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 02:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [64bf257f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [64bf257f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6bda8105 >2014-08-24 02:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [64bf257f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [64bf257f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [64bf257f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [55e49605] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:22 AM >2014-08-24 02:22:23,428 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 02:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [765092f8] Autorecovering 1 storage domains >2014-08-24 02:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [765092f8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6111b6cf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6111b6cf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:25 AM >2014-08-24 02:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4466c787] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4466c787] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 661afef6 >2014-08-24 02:27:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4466c787] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:27:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4466c787] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 661afef6 >2014-08-24 02:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4466c787] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [4466c787] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4466c787] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:27:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6111b6cf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:27 AM >2014-08-24 02:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [b99fca7] Autorecovering 1 storage domains >2014-08-24 02:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [b99fca7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2808001b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2808001b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:30 AM >2014-08-24 02:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4d74b077] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4d74b077] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b71c0e4 >2014-08-24 02:32:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4d74b077] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:32:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4d74b077] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4b71c0e4 >2014-08-24 02:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4d74b077] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:32:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [4d74b077] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4d74b077] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:32:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2808001b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:32 AM >2014-08-24 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [7cd89be6] Autorecovering 1 storage domains >2014-08-24 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [7cd89be6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c8ef4f7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c8ef4f7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:35 AM >2014-08-24 02:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 158b63e6 >2014-08-24 02:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:37:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 158b63e6 >2014-08-24 02:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:37:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3c0c0538] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:37:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c8ef4f7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:37 AM >2014-08-24 02:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [d29decd] Autorecovering 1 storage domains >2014-08-24 02:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [d29decd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [6f529191] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [6f529191] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:40 AM >2014-08-24 02:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [77921ff7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [77921ff7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2708dec6 >2014-08-24 02:40:22,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Attempting to update VMs/Templates Ovf. >2014-08-24 02:40:22,681 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Attempting to update VM OVFs in Data Center Default >2014-08-24 02:40:22,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Successfully updated VM OVFs in Data Center Default >2014-08-24 02:40:22,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Attempting to update template OVFs in Data Center Default >2014-08-24 02:40:22,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Successfully updated templates OVFs in Data Center Default >2014-08-24 02:40:22,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 02:40:22,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) [6fb4971] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 02:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [77921ff7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [77921ff7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2708dec6 >2014-08-24 02:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [77921ff7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [77921ff7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [77921ff7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [6f529191] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:42 AM >2014-08-24 02:42:54,065 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 02:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [103035d] Autorecovering 1 storage domains >2014-08-24 02:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [103035d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4c5a049] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4c5a049] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:45 AM >2014-08-24 02:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 46b79559 >2014-08-24 02:47:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:47:05,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 46b79559 >2014-08-24 02:47:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:47:05,117 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:47:05,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [79d4eaef] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:47:05,122 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4c5a049] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:47 AM >2014-08-24 02:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [3edefae2] Autorecovering 1 storage domains >2014-08-24 02:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [3edefae2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [db9bb8b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [db9bb8b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:50 AM >2014-08-24 02:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [4ba92042] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [4ba92042] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ee2cbde >2014-08-24 02:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [4ba92042] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [4ba92042] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ee2cbde >2014-08-24 02:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [4ba92042] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [4ba92042] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [4ba92042] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [db9bb8b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:52 AM >2014-08-24 02:53:00,196 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 02:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3f9b888c] Autorecovering 1 storage domains >2014-08-24 02:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3f9b888c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 02:55:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3deb93a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 02:55:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3deb93a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:55 AM >2014-08-24 02:55:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [181ca17e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 02:55:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [181ca17e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 23f1a74e >2014-08-24 02:57:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [181ca17e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 02:57:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [181ca17e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 23f1a74e >2014-08-24 02:57:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [181ca17e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 02:57:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [181ca17e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 02:57:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [181ca17e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 02:57:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3deb93a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:57 AM >2014-08-24 03:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [6d08134c] Autorecovering 1 storage domains >2014-08-24 03:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [6d08134c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [63468433] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [63468433] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:00 AM >2014-08-24 03:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [36e176fd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [36e176fd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22375fae >2014-08-24 03:02:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [36e176fd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:02:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [36e176fd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 22375fae >2014-08-24 03:02:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [36e176fd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:02:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [36e176fd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [36e176fd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:02:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [63468433] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:02 AM >2014-08-24 03:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [5f1ed4e6] Autorecovering 1 storage domains >2014-08-24 03:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [5f1ed4e6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7ad110d0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7ad110d0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:05 AM >2014-08-24 03:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [7f22415e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [7f22415e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ad8f7d7 >2014-08-24 03:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [7f22415e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [7f22415e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4ad8f7d7 >2014-08-24 03:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [7f22415e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [7f22415e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [7f22415e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7ad110d0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:07 AM >2014-08-24 03:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [1ead4d39] Autorecovering 1 storage domains >2014-08-24 03:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [1ead4d39] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [47184ddf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [47184ddf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:10 AM >2014-08-24 03:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [71db1666] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [71db1666] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: c72e6cc >2014-08-24 03:12:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [71db1666] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:12:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [71db1666] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: c72e6cc >2014-08-24 03:12:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [71db1666] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [71db1666] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:12:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [71db1666] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:12:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [47184ddf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:12 AM >2014-08-24 03:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [5c8ef4f7] Autorecovering 1 storage domains >2014-08-24 03:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [5c8ef4f7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c52ab7c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c52ab7c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:15 AM >2014-08-24 03:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3e081744] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3e081744] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6dcdd0eb >2014-08-24 03:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3e081744] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:17:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3e081744] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6dcdd0eb >2014-08-24 03:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3e081744] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [3e081744] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3e081744] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [5c52ab7c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:17 AM >2014-08-24 03:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [5c255377] Autorecovering 1 storage domains >2014-08-24 03:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [5c255377] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [2bc53b14] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [2bc53b14] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:20 AM >2014-08-24 03:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [30a6df81] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [30a6df81] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 241f42e0 >2014-08-24 03:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [30a6df81] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [30a6df81] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 241f42e0 >2014-08-24 03:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [30a6df81] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [30a6df81] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [30a6df81] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [2bc53b14] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:22 AM >2014-08-24 03:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [255cb5a8] Autorecovering 1 storage domains >2014-08-24 03:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [255cb5a8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [5ffc84b1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [5ffc84b1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:25 AM >2014-08-24 03:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [d7cec10] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [d7cec10] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c6eeab1 >2014-08-24 03:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [d7cec10] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [d7cec10] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1c6eeab1 >2014-08-24 03:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [d7cec10] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [d7cec10] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [d7cec10] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:27:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [5ffc84b1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:27 AM >2014-08-24 03:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [4f7fdbeb] Autorecovering 1 storage domains >2014-08-24 03:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [4f7fdbeb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4e041279] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4e041279] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:30 AM >2014-08-24 03:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 66abb2b5 >2014-08-24 03:32:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:32:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 66abb2b5 >2014-08-24 03:32:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:32:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:32:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [44fb5bc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:32:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [4e041279] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:32 AM >2014-08-24 03:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [5f5e6e3c] Autorecovering 1 storage domains >2014-08-24 03:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [5f5e6e3c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [60945095] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [60945095] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:35 AM >2014-08-24 03:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [72897f9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [72897f9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65b983fb >2014-08-24 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-5) [58d0a34e] Start deleteAgedOutAuditLogs >2014-08-24 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-5) [58d0a34e] Finished deleteAgedOutAuditLogs >2014-08-24 03:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [72897f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:37:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [72897f9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65b983fb >2014-08-24 03:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [72897f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [72897f9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [72897f9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [60945095] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:37 AM >2014-08-24 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [6656b99] Autorecovering 1 storage domains >2014-08-24 03:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [6656b99] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [603252b7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [603252b7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:40 AM >2014-08-24 03:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [47c0b914] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [47c0b914] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17398920 >2014-08-24 03:40:22,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Attempting to update VMs/Templates Ovf. >2014-08-24 03:40:22,685 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Attempting to update VM OVFs in Data Center Default >2014-08-24 03:40:22,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Successfully updated VM OVFs in Data Center Default >2014-08-24 03:40:22,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Attempting to update template OVFs in Data Center Default >2014-08-24 03:40:22,688 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Successfully updated templates OVFs in Data Center Default >2014-08-24 03:40:22,688 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 03:40:22,689 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 03:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [47c0b914] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [47c0b914] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17398920 >2014-08-24 03:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [47c0b914] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [47c0b914] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [47c0b914] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [603252b7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:42 AM >2014-08-24 03:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3deb93a] Autorecovering 1 storage domains >2014-08-24 03:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3deb93a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3257a2f3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3257a2f3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:45 AM >2014-08-24 03:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7fc8bb42 >2014-08-24 03:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:47:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7fc8bb42 >2014-08-24 03:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:47:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [2b7e60cd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [3257a2f3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:47 AM >2014-08-24 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [1a5e2f65] Autorecovering 1 storage domains >2014-08-24 03:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [1a5e2f65] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [3489e885] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [3489e885] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:50 AM >2014-08-24 03:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6485c00b >2014-08-24 03:52:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:52:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6485c00b >2014-08-24 03:52:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:52:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:52:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [23bdeb1a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:52:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [3489e885] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:52 AM >2014-08-24 03:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [59b219] Autorecovering 1 storage domains >2014-08-24 03:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [59b219] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3793860a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3793860a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:55 AM >2014-08-24 03:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 03:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1819f75a >2014-08-24 03:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 03:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1819f75a >2014-08-24 03:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 03:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 03:57:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [47ea95b5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 03:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3793860a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:57 AM >2014-08-24 04:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [2bc53b14] Autorecovering 1 storage domains >2014-08-24 04:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [2bc53b14] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [3e80b670] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [3e80b670] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:00 AM >2014-08-24 04:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b99ba9c >2014-08-24 04:02:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:02:05,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b99ba9c >2014-08-24 04:02:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:02:05,123 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:02:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [15d7aee8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:02:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [3e80b670] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:02 AM >2014-08-24 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [1ad144e1] Autorecovering 1 storage domains >2014-08-24 04:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [1ad144e1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [45609cd2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [45609cd2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:05 AM >2014-08-24 04:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 27c756b >2014-08-24 04:07:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:07:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 27c756b >2014-08-24 04:07:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:07:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:07:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [61ccfaf5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:07:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [45609cd2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:07 AM >2014-08-24 04:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [3f0358fc] Autorecovering 1 storage domains >2014-08-24 04:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [3f0358fc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [275e4b68] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [275e4b68] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:10 AM >2014-08-24 04:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4915ff8f >2014-08-24 04:10:31,855 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 04:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4915ff8f >2014-08-24 04:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:12:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3e5d4389] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [275e4b68] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:12 AM >2014-08-24 04:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [18a23936] Autorecovering 1 storage domains >2014-08-24 04:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [18a23936] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [59b48056] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [59b48056] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:15 AM >2014-08-24 04:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4584ef74] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [4584ef74] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1eeb24ac >2014-08-24 04:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [4584ef74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [4584ef74] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1eeb24ac >2014-08-24 04:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [4584ef74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [4584ef74] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [4584ef74] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [59b48056] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:17 AM >2014-08-24 04:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [641e8d79] Autorecovering 1 storage domains >2014-08-24 04:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [641e8d79] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [178bac92] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [178bac92] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:20 AM >2014-08-24 04:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 66fdeea5 >2014-08-24 04:22:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:22:05,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 66fdeea5 >2014-08-24 04:22:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:22:05,119 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:22:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [6b1f6da5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:22:05,124 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [178bac92] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:22 AM >2014-08-24 04:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [b94a5a2] Autorecovering 1 storage domains >2014-08-24 04:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [b94a5a2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:25:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [2e3c3fa6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:25:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [2e3c3fa6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:25 AM >2014-08-24 04:25:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [725fdf7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [725fdf7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ec7e24 >2014-08-24 04:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [725fdf7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [725fdf7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5ec7e24 >2014-08-24 04:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [725fdf7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [725fdf7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [725fdf7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:27:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [2e3c3fa6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:27 AM >2014-08-24 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [334b864b] Autorecovering 1 storage domains >2014-08-24 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [334b864b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [3b7e7806] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [3b7e7806] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:30 AM >2014-08-24 04:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [35380d2f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [35380d2f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 363cbda0 >2014-08-24 04:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [35380d2f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:32:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [35380d2f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 363cbda0 >2014-08-24 04:32:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [35380d2f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [35380d2f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:32:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [35380d2f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:32:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [3b7e7806] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:32 AM >2014-08-24 04:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7cdec9e2] Autorecovering 1 storage domains >2014-08-24 04:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7cdec9e2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [10f6754e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [10f6754e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:35 AM >2014-08-24 04:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [12761153] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [12761153] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d100604 >2014-08-24 04:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [12761153] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:37:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [12761153] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2d100604 >2014-08-24 04:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [12761153] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [12761153] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [12761153] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:37:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [10f6754e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:37 AM >2014-08-24 04:38:34,103 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 04:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [16a56e] Autorecovering 1 storage domains >2014-08-24 04:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [16a56e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6364e258] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6364e258] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:40 AM >2014-08-24 04:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68f40fc >2014-08-24 04:40:22,689 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Attempting to update VMs/Templates Ovf. >2014-08-24 04:40:22,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Attempting to update VM OVFs in Data Center Default >2014-08-24 04:40:22,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Successfully updated VM OVFs in Data Center Default >2014-08-24 04:40:22,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Attempting to update template OVFs in Data Center Default >2014-08-24 04:40:22,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Successfully updated templates OVFs in Data Center Default >2014-08-24 04:40:22,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 04:40:22,694 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [45609cd2] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 04:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:42:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68f40fc >2014-08-24 04:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:42:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [6fa5c944] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:42:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6364e258] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:42 AM >2014-08-24 04:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [74455e77] Autorecovering 1 storage domains >2014-08-24 04:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [74455e77] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [76bc70bc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [76bc70bc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:45 AM >2014-08-24 04:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5df1424a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5df1424a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 351d37d5 >2014-08-24 04:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5df1424a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:47:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5df1424a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 351d37d5 >2014-08-24 04:47:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5df1424a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:47:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [5df1424a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:47:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5df1424a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:47:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [76bc70bc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:47 AM >2014-08-24 04:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [275e4b68] Autorecovering 1 storage domains >2014-08-24 04:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [275e4b68] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [13379952] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [13379952] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:50 AM >2014-08-24 04:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 517cdfac >2014-08-24 04:52:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:52:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 517cdfac >2014-08-24 04:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:52:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [21f1a0fe] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:52:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [13379952] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:52 AM >2014-08-24 04:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [13250d88] Autorecovering 1 storage domains >2014-08-24 04:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [13250d88] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 04:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [55b309c2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 04:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [55b309c2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:55 AM >2014-08-24 04:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [1b498ead] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 04:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [1b498ead] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41fecbed >2014-08-24 04:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [1b498ead] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 04:57:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [1b498ead] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41fecbed >2014-08-24 04:57:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [1b498ead] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 04:57:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [1b498ead] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 04:57:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [1b498ead] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 04:57:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [55b309c2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:57 AM >2014-08-24 05:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [4acce1d2] Autorecovering 1 storage domains >2014-08-24 05:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [4acce1d2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [60f52d16] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [60f52d16] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:00 AM >2014-08-24 05:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1321a870 >2014-08-24 05:02:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:02:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1321a870 >2014-08-24 05:02:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:02:05,129 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:02:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [10cfbd8e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:02:05,133 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [60f52d16] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:02 AM >2014-08-24 05:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [2e3c3fa6] Autorecovering 1 storage domains >2014-08-24 05:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [2e3c3fa6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [812142a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [812142a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:05 AM >2014-08-24 05:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79b9e87b >2014-08-24 05:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:07:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79b9e87b >2014-08-24 05:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:07:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [6d44d1f8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [812142a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:07 AM >2014-08-24 05:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [16635780] Autorecovering 1 storage domains >2014-08-24 05:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [16635780] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [55de6e90] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [55de6e90] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:10 AM >2014-08-24 05:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4412120 >2014-08-24 05:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4412120 >2014-08-24 05:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:12:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [2b153a5d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [55de6e90] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:12 AM >2014-08-24 05:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [23a91561] Autorecovering 1 storage domains >2014-08-24 05:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [23a91561] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:15:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3fff53f3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:15:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3fff53f3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:15 AM >2014-08-24 05:15:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [45fdf932] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:15:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [45fdf932] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37f76558 >2014-08-24 05:17:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [45fdf932] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:17:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [45fdf932] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 37f76558 >2014-08-24 05:17:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [45fdf932] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:17:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [45fdf932] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:17:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [45fdf932] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:17:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3fff53f3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:17 AM >2014-08-24 05:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [60945095] Autorecovering 1 storage domains >2014-08-24 05:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [60945095] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [67d60bc8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [67d60bc8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:20 AM >2014-08-24 05:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [43d343b2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [43d343b2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 57e13277 >2014-08-24 05:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [43d343b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [43d343b2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 57e13277 >2014-08-24 05:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [43d343b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [43d343b2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [43d343b2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:22:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [67d60bc8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:22 AM >2014-08-24 05:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [f23b0de] Autorecovering 1 storage domains >2014-08-24 05:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [f23b0de] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:25 AM >2014-08-24 05:25:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [305462bf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:25:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [305462bf] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19bf480b >2014-08-24 05:27:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [305462bf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:27:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [305462bf] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 19bf480b >2014-08-24 05:27:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [305462bf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:27:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [305462bf] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:27:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [305462bf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:27:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:27 AM >2014-08-24 05:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [6f529191] Autorecovering 1 storage domains >2014-08-24 05:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-70) [6f529191] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2ce12797] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2ce12797] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:30 AM >2014-08-24 05:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6d105b74] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6d105b74] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1efd6a1d >2014-08-24 05:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6d105b74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:32:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6d105b74] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1efd6a1d >2014-08-24 05:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6d105b74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:32:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [6d105b74] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6d105b74] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:32:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-70) [2ce12797] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:32 AM >2014-08-24 05:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [6ccace8c] Autorecovering 1 storage domains >2014-08-24 05:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [6ccace8c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [9e07b3d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [9e07b3d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:35 AM >2014-08-24 05:35:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 77522304 >2014-08-24 05:37:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:37:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 77522304 >2014-08-24 05:37:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:37:05,117 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:37:05,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [3ecbc3f2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:37:05,122 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [9e07b3d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:37 AM >2014-08-24 05:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [4ed27de] Autorecovering 1 storage domains >2014-08-24 05:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [4ed27de] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [74db1e33] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [74db1e33] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:40 AM >2014-08-24 05:40:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [47958709] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:40:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [47958709] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20523f2d >2014-08-24 05:40:22,694 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Attempting to update VMs/Templates Ovf. >2014-08-24 05:40:22,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Attempting to update VM OVFs in Data Center Default >2014-08-24 05:40:22,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Successfully updated VM OVFs in Data Center Default >2014-08-24 05:40:22,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Attempting to update template OVFs in Data Center Default >2014-08-24 05:40:22,699 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Successfully updated templates OVFs in Data Center Default >2014-08-24 05:40:22,699 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 05:40:22,700 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) [5df2a436] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 05:42:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [47958709] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:42:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [47958709] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 20523f2d >2014-08-24 05:42:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [47958709] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:42:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [47958709] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:42:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [47958709] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:42:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [74db1e33] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:42 AM >2014-08-24 05:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [3e80b670] Autorecovering 1 storage domains >2014-08-24 05:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [3e80b670] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [4c4681b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [4c4681b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:45 AM >2014-08-24 05:45:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [c796595] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [c796595] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 296d6efc >2014-08-24 05:47:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [c796595] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:47:05,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [c796595] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 296d6efc >2014-08-24 05:47:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [c796595] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:47:05,144 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [c796595] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:47:05,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [c796595] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:47:05,148 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [4c4681b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:47 AM >2014-08-24 05:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [7e54b4c9] Autorecovering 1 storage domains >2014-08-24 05:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [7e54b4c9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [cc79bb6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [cc79bb6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:50 AM >2014-08-24 05:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f0bbc8f >2014-08-24 05:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f0bbc8f >2014-08-24 05:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:52:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [7dd88b5b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [cc79bb6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:52 AM >2014-08-24 05:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [4c5a049] Autorecovering 1 storage domains >2014-08-24 05:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [4c5a049] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 05:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [72e7f0ad] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 05:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [72e7f0ad] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:55 AM >2014-08-24 05:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [16186917] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 05:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [16186917] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70b15b87 >2014-08-24 05:57:05,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [16186917] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 05:57:05,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [16186917] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 70b15b87 >2014-08-24 05:57:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [16186917] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 05:57:05,143 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-10) [16186917] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 05:57:05,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [16186917] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 05:57:05,148 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [72e7f0ad] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:57 AM >2014-08-24 06:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [8c6b263] Autorecovering 1 storage domains >2014-08-24 06:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [8c6b263] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [1c6e5be4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [1c6e5be4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:00 AM >2014-08-24 06:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [30445916] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [30445916] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d5105dc >2014-08-24 06:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [30445916] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:02:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [30445916] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d5105dc >2014-08-24 06:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [30445916] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [30445916] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [30445916] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [1c6e5be4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:02 AM >2014-08-24 06:04:11,502 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 06:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [1967022f] Autorecovering 1 storage domains >2014-08-24 06:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [1967022f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6373fd23] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6373fd23] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:05 AM >2014-08-24 06:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [51964374] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:05:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [51964374] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3d31b13b >2014-08-24 06:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [51964374] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [51964374] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3d31b13b >2014-08-24 06:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [51964374] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [51964374] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [51964374] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:07:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [6373fd23] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:07 AM >2014-08-24 06:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [63468433] Autorecovering 1 storage domains >2014-08-24 06:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [63468433] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [46c78fbd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [46c78fbd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:10 AM >2014-08-24 06:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d57056a >2014-08-24 06:12:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:12:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d57056a >2014-08-24 06:12:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:12:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [71b79fa4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:12:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [46c78fbd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:12 AM >2014-08-24 06:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [aa021e] Autorecovering 1 storage domains >2014-08-24 06:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [aa021e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [9321f1f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [9321f1f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:15 AM >2014-08-24 06:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [39806479] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [39806479] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 78d10f68 >2014-08-24 06:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [39806479] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [39806479] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 78d10f68 >2014-08-24 06:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [39806479] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [39806479] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [39806479] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [9321f1f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:17 AM >2014-08-24 06:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [74db1e33] Autorecovering 1 storage domains >2014-08-24 06:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [74db1e33] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [2ef788d6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [2ef788d6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:20 AM >2014-08-24 06:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [fc30501] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [fc30501] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2b32fb6b >2014-08-24 06:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [fc30501] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [fc30501] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2b32fb6b >2014-08-24 06:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [fc30501] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [fc30501] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [fc30501] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [2ef788d6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:22 AM >2014-08-24 06:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [6cf6f1a0] Autorecovering 1 storage domains >2014-08-24 06:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [6cf6f1a0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [5b15d145] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [5b15d145] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:25 AM >2014-08-24 06:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3c669816] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3c669816] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1734ebd6 >2014-08-24 06:27:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3c669816] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:27:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [3c669816] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1734ebd6 >2014-08-24 06:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [3c669816] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:27:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [3c669816] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [3c669816] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:27:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [5b15d145] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:27 AM >2014-08-24 06:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [4e041279] Autorecovering 1 storage domains >2014-08-24 06:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [4e041279] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [778cb0d5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [778cb0d5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:30 AM >2014-08-24 06:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [18181e78] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [18181e78] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3bd56ce6 >2014-08-24 06:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [18181e78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [18181e78] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3bd56ce6 >2014-08-24 06:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [18181e78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [18181e78] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:32:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [18181e78] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:32:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [778cb0d5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:32 AM >2014-08-24 06:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [4da62f93] Autorecovering 1 storage domains >2014-08-24 06:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [4da62f93] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [473ff6a9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [473ff6a9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:35 AM >2014-08-24 06:35:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:35:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 47c8b45e >2014-08-24 06:37:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:37:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 47c8b45e >2014-08-24 06:37:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:37:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:37:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [46ec8d7c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:37:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [473ff6a9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:37 AM >2014-08-24 06:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [6dbe4ae] Autorecovering 1 storage domains >2014-08-24 06:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [6dbe4ae] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [5fc5f3f0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [5fc5f3f0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:40 AM >2014-08-24 06:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4011e157 >2014-08-24 06:40:22,700 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Attempting to update VMs/Templates Ovf. >2014-08-24 06:40:22,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Attempting to update VM OVFs in Data Center Default >2014-08-24 06:40:22,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Successfully updated VM OVFs in Data Center Default >2014-08-24 06:40:22,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Attempting to update template OVFs in Data Center Default >2014-08-24 06:40:22,705 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Successfully updated templates OVFs in Data Center Default >2014-08-24 06:40:22,705 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 06:40:22,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 06:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4011e157 >2014-08-24 06:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [192dd8f7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [5fc5f3f0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:42 AM >2014-08-24 06:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [773b374b] Autorecovering 1 storage domains >2014-08-24 06:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [773b374b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [5636d843] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [5636d843] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:45 AM >2014-08-24 06:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [172e1613] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [172e1613] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 92b4740 >2014-08-24 06:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [172e1613] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:47:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [172e1613] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 92b4740 >2014-08-24 06:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [172e1613] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:47:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [172e1613] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [172e1613] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [5636d843] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:47 AM >2014-08-24 06:50:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Autorecovering 1 storage domains >2014-08-24 06:50:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-10) [1bda5bae] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:50:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:50:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [1b437dc7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:50 AM >2014-08-24 06:50:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:50:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 413bb76c >2014-08-24 06:52:05,146 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:52:05,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 413bb76c >2014-08-24 06:52:05,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:52:05,147 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:52:05,151 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [55ad1a34] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:52:05,151 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-10) [1b437dc7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:52 AM >2014-08-24 06:52:25,533 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 06:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [9321f1f] Autorecovering 1 storage domains >2014-08-24 06:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [9321f1f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 06:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [71393e46] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 06:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [71393e46] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:55 AM >2014-08-24 06:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 06:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b640ae6 >2014-08-24 06:57:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 06:57:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5b640ae6 >2014-08-24 06:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 06:57:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 06:57:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [6b32b5d9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 06:57:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [71393e46] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:57 AM >2014-08-24 07:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Autorecovering 1 storage domains >2014-08-24 07:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [31b5ee83] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [3dd35be9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [3dd35be9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:00 AM >2014-08-24 07:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f351b03 >2014-08-24 07:02:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:02:05,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3f351b03 >2014-08-24 07:02:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:02:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [3d11a20f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:02:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [3dd35be9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:02 AM >2014-08-24 07:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [55de6e90] Autorecovering 1 storage domains >2014-08-24 07:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [55de6e90] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:05 AM >2014-08-24 07:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [795f40e2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [795f40e2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6dac3fb4 >2014-08-24 07:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [795f40e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [795f40e2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6dac3fb4 >2014-08-24 07:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [795f40e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [795f40e2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [795f40e2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:07 AM >2014-08-24 07:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [2ef48484] Autorecovering 1 storage domains >2014-08-24 07:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [2ef48484] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [34584623] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [34584623] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:10 AM >2014-08-24 07:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [796afaf1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [796afaf1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e86b3b8 >2014-08-24 07:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [796afaf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [796afaf1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6e86b3b8 >2014-08-24 07:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [796afaf1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [796afaf1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [796afaf1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [34584623] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:12 AM >2014-08-24 07:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3793860a] Autorecovering 1 storage domains >2014-08-24 07:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [3793860a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [35e33c62] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [35e33c62] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:15 AM >2014-08-24 07:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [22e54682] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [22e54682] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 374e1745 >2014-08-24 07:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [22e54682] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [22e54682] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 374e1745 >2014-08-24 07:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [22e54682] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-10) [22e54682] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [22e54682] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [35e33c62] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:17 AM >2014-08-24 07:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [178bac92] Autorecovering 1 storage domains >2014-08-24 07:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [178bac92] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [7413ada9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [7413ada9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:20 AM >2014-08-24 07:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 27a732f8 >2014-08-24 07:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 27a732f8 >2014-08-24 07:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [4dd28d5a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [7413ada9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:22 AM >2014-08-24 07:24:15,044 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 07:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [e8bfc57] Autorecovering 1 storage domains >2014-08-24 07:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [e8bfc57] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44cdde80] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44cdde80] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:25 AM >2014-08-24 07:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [27e731ce] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [27e731ce] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5db1dec7 >2014-08-24 07:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [27e731ce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [27e731ce] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5db1dec7 >2014-08-24 07:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [27e731ce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-25) [27e731ce] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [27e731ce] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:27:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44cdde80] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:27 AM >2014-08-24 07:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [5c52ab7c] Autorecovering 1 storage domains >2014-08-24 07:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [5c52ab7c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [54ce0936] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [54ce0936] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:30 AM >2014-08-24 07:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [58691f25] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [58691f25] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3d47354 >2014-08-24 07:32:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [58691f25] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:32:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [58691f25] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3d47354 >2014-08-24 07:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [58691f25] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:32:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [58691f25] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [58691f25] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:32:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [54ce0936] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:32 AM >2014-08-24 07:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [32d092d2] Autorecovering 1 storage domains >2014-08-24 07:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [32d092d2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [37a44805] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [37a44805] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:35 AM >2014-08-24 07:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4d8bb50b >2014-08-24 07:37:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:37:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4d8bb50b >2014-08-24 07:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:37:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:37:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [64f53dcc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:37:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [37a44805] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:37 AM >2014-08-24 07:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [28a58e63] Autorecovering 1 storage domains >2014-08-24 07:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [28a58e63] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [38527cf6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [38527cf6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:40 AM >2014-08-24 07:40:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [a10e61c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:40:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [a10e61c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 31cbc15d >2014-08-24 07:40:22,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Attempting to update VMs/Templates Ovf. >2014-08-24 07:40:22,708 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Attempting to update VM OVFs in Data Center Default >2014-08-24 07:40:22,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Successfully updated VM OVFs in Data Center Default >2014-08-24 07:40:22,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Attempting to update template OVFs in Data Center Default >2014-08-24 07:40:22,710 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Successfully updated templates OVFs in Data Center Default >2014-08-24 07:40:22,710 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 07:40:22,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) [38215689] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 07:42:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [a10e61c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:42:05,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [a10e61c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 31cbc15d >2014-08-24 07:42:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [a10e61c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:42:05,114 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-46) [a10e61c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:42:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [a10e61c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:42:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [38527cf6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:42 AM >2014-08-24 07:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [1816bdac] Autorecovering 1 storage domains >2014-08-24 07:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [1816bdac] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [597cc33d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [597cc33d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:45 AM >2014-08-24 07:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f97cf2a >2014-08-24 07:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:47:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f97cf2a >2014-08-24 07:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:47:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:47:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [2f7a72a8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:47:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [597cc33d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:47 AM >2014-08-24 07:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [6d210993] Autorecovering 1 storage domains >2014-08-24 07:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [6d210993] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [d908d8e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [d908d8e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:50 AM >2014-08-24 07:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 726d2fe9 >2014-08-24 07:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 726d2fe9 >2014-08-24 07:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:52:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [58dcf7df] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [d908d8e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:52 AM >2014-08-24 07:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [603252b7] Autorecovering 1 storage domains >2014-08-24 07:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [603252b7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 07:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [12bd47ea] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 07:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [12bd47ea] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:55 AM >2014-08-24 07:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [222627c3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 07:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [222627c3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18511eb6 >2014-08-24 07:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [222627c3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 07:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [222627c3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 18511eb6 >2014-08-24 07:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [222627c3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 07:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [222627c3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 07:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [222627c3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 07:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [12bd47ea] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:57 AM >2014-08-24 08:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [505f2dab] Autorecovering 1 storage domains >2014-08-24 08:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [505f2dab] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [7dc0d9ba] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [7dc0d9ba] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:00 AM >2014-08-24 08:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 252682f3 >2014-08-24 08:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:02:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 252682f3 >2014-08-24 08:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:02:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [59d74a5d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [7dc0d9ba] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:02 AM >2014-08-24 08:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [44cdde80] Autorecovering 1 storage domains >2014-08-24 08:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [44cdde80] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [481569d8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [481569d8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:05 AM >2014-08-24 08:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [c8537c8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [c8537c8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6a79ee24 >2014-08-24 08:07:05,096 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [c8537c8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:07:05,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [c8537c8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6a79ee24 >2014-08-24 08:07:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [c8537c8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:07:05,097 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [c8537c8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [c8537c8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:07:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [481569d8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:07 AM >2014-08-24 08:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [14cf7f75] Autorecovering 1 storage domains >2014-08-24 08:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-50) [14cf7f75] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [ce653cf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [ce653cf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:10 AM >2014-08-24 08:10:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [72c581d2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:10:00,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [72c581d2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56708bc2 >2014-08-24 08:12:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [72c581d2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:12:05,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [72c581d2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 56708bc2 >2014-08-24 08:12:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [72c581d2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:12:05,119 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [72c581d2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:12:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [72c581d2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:12:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-50) [ce653cf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:12 AM >2014-08-24 08:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [5892375] Autorecovering 1 storage domains >2014-08-24 08:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [5892375] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:15:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [71431860] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:15:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [71431860] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:15 AM >2014-08-24 08:15:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e04340b >2014-08-24 08:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e04340b >2014-08-24 08:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [2165ffd9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [71431860] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:17 AM >2014-08-24 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [1ec26128] Autorecovering 1 storage domains >2014-08-24 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [1ec26128] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [77bca3a0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [77bca3a0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:20 AM >2014-08-24 08:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [534a0369] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [534a0369] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b7e75df >2014-08-24 08:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [534a0369] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:22:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [534a0369] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b7e75df >2014-08-24 08:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [534a0369] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [534a0369] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [534a0369] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [77bca3a0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:22 AM >2014-08-24 08:24:36,537 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [3fff53f3] Autorecovering 1 storage domains >2014-08-24 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [3fff53f3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [5df3f313] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [5df3f313] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:25 AM >2014-08-24 08:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2799a8c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2799a8c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 75581f4b >2014-08-24 08:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2799a8c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2799a8c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 75581f4b >2014-08-24 08:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2799a8c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [2799a8c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2799a8c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:27:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [5df3f313] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:27 AM >2014-08-24 08:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [473ff6a9] Autorecovering 1 storage domains >2014-08-24 08:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [473ff6a9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [6df07de7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [6df07de7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:30 AM >2014-08-24 08:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [46a53141] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [46a53141] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4d2cacb1 >2014-08-24 08:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [46a53141] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [46a53141] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4d2cacb1 >2014-08-24 08:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [46a53141] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [46a53141] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [46a53141] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [6df07de7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:32 AM >2014-08-24 08:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [3dd35be9] Autorecovering 1 storage domains >2014-08-24 08:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [3dd35be9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [11bb20a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [11bb20a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:35 AM >2014-08-24 08:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6037cf30] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [6037cf30] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ce58bc0 >2014-08-24 08:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [6037cf30] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:37:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [6037cf30] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5ce58bc0 >2014-08-24 08:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [6037cf30] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [6037cf30] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6037cf30] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [11bb20a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:37 AM >2014-08-24 08:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [3310e790] Autorecovering 1 storage domains >2014-08-24 08:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [3310e790] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [5e0a1f4e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [5e0a1f4e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:40 AM >2014-08-24 08:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [1d375d90] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [1d375d90] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 222035e9 >2014-08-24 08:40:22,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Attempting to update VMs/Templates Ovf. >2014-08-24 08:40:22,713 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Attempting to update VM OVFs in Data Center Default >2014-08-24 08:40:22,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Successfully updated VM OVFs in Data Center Default >2014-08-24 08:40:22,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Attempting to update template OVFs in Data Center Default >2014-08-24 08:40:22,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Successfully updated templates OVFs in Data Center Default >2014-08-24 08:40:22,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 08:40:22,716 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) [6364e258] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 08:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [1d375d90] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:42:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [1d375d90] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 222035e9 >2014-08-24 08:42:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [1d375d90] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [1d375d90] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:42:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [1d375d90] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:42:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [5e0a1f4e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:42 AM >2014-08-24 08:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [55e49605] Autorecovering 1 storage domains >2014-08-24 08:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [55e49605] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [22db019] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [22db019] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:45 AM >2014-08-24 08:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [3c427b03] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:45:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [3c427b03] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 175f55b7 >2014-08-24 08:47:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [3c427b03] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:47:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [3c427b03] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 175f55b7 >2014-08-24 08:47:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [3c427b03] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:47:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [3c427b03] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:47:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [3c427b03] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:47:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [22db019] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:47 AM >2014-08-24 08:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [47184ddf] Autorecovering 1 storage domains >2014-08-24 08:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [47184ddf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3192aaf3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:50:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3192aaf3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:50 AM >2014-08-24 08:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [4db31434] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4db31434] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4fbabf16 >2014-08-24 08:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [4db31434] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4db31434] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4fbabf16 >2014-08-24 08:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [4db31434] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-27) [4db31434] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [4db31434] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3192aaf3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:52 AM >2014-08-24 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [71431860] Autorecovering 1 storage domains >2014-08-24 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [71431860] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 08:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [283b0371] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 08:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [283b0371] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:55 AM >2014-08-24 08:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [51fef35a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 08:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51fef35a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: b563423 >2014-08-24 08:57:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [51fef35a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 08:57:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [51fef35a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: b563423 >2014-08-24 08:57:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [51fef35a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 08:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [51fef35a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 08:57:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [51fef35a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 08:57:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [283b0371] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:57 AM >2014-08-24 09:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [125c7d8] Autorecovering 1 storage domains >2014-08-24 09:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [125c7d8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:00:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [73a0a606] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:00:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [73a0a606] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:00 AM >2014-08-24 09:00:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [33ca543f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:00:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [33ca543f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 669e6b73 >2014-08-24 09:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [33ca543f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:02:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [33ca543f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 669e6b73 >2014-08-24 09:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [33ca543f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [33ca543f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [33ca543f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [73a0a606] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:02 AM >2014-08-24 09:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3257a2f3] Autorecovering 1 storage domains >2014-08-24 09:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [3257a2f3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:05:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [5bd1311e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:05:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [5bd1311e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:05 AM >2014-08-24 09:05:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:05:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1099d383 >2014-08-24 09:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:07:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1099d383 >2014-08-24 09:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:07:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [7c0cf860] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:07:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [5bd1311e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:07 AM >2014-08-24 09:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [5b69f3dc] Autorecovering 1 storage domains >2014-08-24 09:10:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [5b69f3dc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:10:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [653005bc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:10:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [653005bc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:10 AM >2014-08-24 09:10:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [780bb31d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:10:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [780bb31d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f7c8777 >2014-08-24 09:12:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [780bb31d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:12:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [780bb31d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f7c8777 >2014-08-24 09:12:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [780bb31d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [780bb31d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:12:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [780bb31d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:12:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [653005bc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:12 AM >2014-08-24 09:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [4f969442] Autorecovering 1 storage domains >2014-08-24 09:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [4f969442] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:15:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [696c0695] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:15:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [696c0695] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:15 AM >2014-08-24 09:15:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:15:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69540728 >2014-08-24 09:17:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:17:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69540728 >2014-08-24 09:17:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:17:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2d4530b3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:17:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [696c0695] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:17 AM >2014-08-24 09:18:24,254 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 09:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [5e0a1f4e] Autorecovering 1 storage domains >2014-08-24 09:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [5e0a1f4e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [444c0071] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [444c0071] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:20 AM >2014-08-24 09:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5d65c947] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5d65c947] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44eb50d9 >2014-08-24 09:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5d65c947] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5d65c947] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 44eb50d9 >2014-08-24 09:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5d65c947] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [5d65c947] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5d65c947] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [444c0071] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:22 AM >2014-08-24 09:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [420ecaf9] Autorecovering 1 storage domains >2014-08-24 09:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [420ecaf9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [573512e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [573512e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:25 AM >2014-08-24 09:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [250316f5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [250316f5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d97cfdb >2014-08-24 09:27:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [250316f5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:27:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [250316f5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: d97cfdb >2014-08-24 09:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [250316f5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:27:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [250316f5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [250316f5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:27:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [573512e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:27 AM >2014-08-24 09:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [597cc33d] Autorecovering 1 storage domains >2014-08-24 09:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [597cc33d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [a9ac9fa] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [a9ac9fa] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:30 AM >2014-08-24 09:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 53bcc9bb >2014-08-24 09:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 53bcc9bb >2014-08-24 09:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [1b7bedfb] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [a9ac9fa] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:32 AM >2014-08-24 09:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [6b866323] Autorecovering 1 storage domains >2014-08-24 09:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-3) [6b866323] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:35 AM >2014-08-24 09:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1d085629 >2014-08-24 09:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:37:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1d085629 >2014-08-24 09:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:37:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [d6f6c58] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:37:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:37 AM >2014-08-24 09:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [54843041] Autorecovering 1 storage domains >2014-08-24 09:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [54843041] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [6827bdd3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [6827bdd3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:40 AM >2014-08-24 09:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5e577132 >2014-08-24 09:40:22,717 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Attempting to update VMs/Templates Ovf. >2014-08-24 09:40:22,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Attempting to update VM OVFs in Data Center Default >2014-08-24 09:40:22,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Successfully updated VM OVFs in Data Center Default >2014-08-24 09:40:22,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Attempting to update template OVFs in Data Center Default >2014-08-24 09:40:22,720 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Successfully updated templates OVFs in Data Center Default >2014-08-24 09:40:22,720 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 09:40:22,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) [73794435] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 09:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5e577132 >2014-08-24 09:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [6b484a8e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:42:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [6827bdd3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:42 AM >2014-08-24 09:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [560dcf70] Autorecovering 1 storage domains >2014-08-24 09:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [560dcf70] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6575c65d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6575c65d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:45 AM >2014-08-24 09:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [2a735367] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [2a735367] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6883bc9e >2014-08-24 09:47:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [2a735367] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:47:05,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [2a735367] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6883bc9e >2014-08-24 09:47:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [2a735367] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:47:05,123 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [2a735367] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:47:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [2a735367] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:47:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [6575c65d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:47 AM >2014-08-24 09:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [521e71e5] Autorecovering 1 storage domains >2014-08-24 09:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [521e71e5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [7fdce1b2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [7fdce1b2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:50 AM >2014-08-24 09:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [1093d543] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [1093d543] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3f2d2aad >2014-08-24 09:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [1093d543] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:52:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [1093d543] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3f2d2aad >2014-08-24 09:52:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [1093d543] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [1093d543] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:52:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [1093d543] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:52:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [7fdce1b2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:52 AM >2014-08-24 09:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [1c6e5be4] Autorecovering 1 storage domains >2014-08-24 09:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [1c6e5be4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 09:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6a418887] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 09:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6a418887] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:55 AM >2014-08-24 09:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 09:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17b9beff >2014-08-24 09:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 09:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17b9beff >2014-08-24 09:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 09:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 09:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [ec6afe7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 09:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [6a418887] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:57 AM >2014-08-24 09:59:18,801 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 10:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [481569d8] Autorecovering 1 storage domains >2014-08-24 10:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [481569d8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:00:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [1505ed1c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:00 AM >2014-08-24 10:00:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [368dd505] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:00:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [368dd505] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e524936 >2014-08-24 10:00:34,529 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 10:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [368dd505] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:02:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [368dd505] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4e524936 >2014-08-24 10:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [368dd505] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [368dd505] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [368dd505] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [1505ed1c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:02 AM >2014-08-24 10:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [76bc70bc] Autorecovering 1 storage domains >2014-08-24 10:05:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [76bc70bc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:05:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [748829b4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:05:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [748829b4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:05 AM >2014-08-24 10:05:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5db72042 >2014-08-24 10:07:05,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:07:05,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5db72042 >2014-08-24 10:07:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:07:05,129 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:07:05,134 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [5c9ef4ca] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:07:05,134 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [748829b4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:07 AM >2014-08-24 10:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [5fffc26f] Autorecovering 1 storage domains >2014-08-24 10:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [5fffc26f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [44a96394] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [44a96394] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:10 AM >2014-08-24 10:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [2375106c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2375106c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17bf8137 >2014-08-24 10:12:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [2375106c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:12:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [2375106c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17bf8137 >2014-08-24 10:12:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [2375106c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [2375106c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:12:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [2375106c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:12:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [44a96394] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:12 AM >2014-08-24 10:14:58,253 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 10:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [38215689] Autorecovering 1 storage domains >2014-08-24 10:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [38215689] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [18a65f6e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [18a65f6e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:15 AM >2014-08-24 10:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [79239fa2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [79239fa2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 51bfd861 >2014-08-24 10:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [79239fa2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [79239fa2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 51bfd861 >2014-08-24 10:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [79239fa2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [79239fa2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [79239fa2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [18a65f6e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:17 AM >2014-08-24 10:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [11bb20a] Autorecovering 1 storage domains >2014-08-24 10:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [11bb20a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [45510532] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [45510532] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:20 AM >2014-08-24 10:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a73a510 >2014-08-24 10:22:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:22:05,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4a73a510 >2014-08-24 10:22:05,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:22:05,134 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:22:05,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [6b6fda8e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:22:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [45510532] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:22 AM >2014-08-24 10:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [6fd11cf3] Autorecovering 1 storage domains >2014-08-24 10:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [6fd11cf3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [55ffbe4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [55ffbe4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:25 AM >2014-08-24 10:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ecf35d7 >2014-08-24 10:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ecf35d7 >2014-08-24 10:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [1e7f2dcd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:27:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [55ffbe4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:27 AM >2014-08-24 10:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [22db019] Autorecovering 1 storage domains >2014-08-24 10:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [22db019] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [442b46a8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [442b46a8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:30 AM >2014-08-24 10:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 11b6b102 >2014-08-24 10:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 11b6b102 >2014-08-24 10:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [464fdbb5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:32:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [442b46a8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:32 AM >2014-08-24 10:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [1c27fc25] Autorecovering 1 storage domains >2014-08-24 10:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [1c27fc25] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4ed1230f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4ed1230f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:35 AM >2014-08-24 10:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 592976cc >2014-08-24 10:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:37:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 592976cc >2014-08-24 10:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:37:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [2c7ba9c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [4ed1230f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:37 AM >2014-08-24 10:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [67d60bc8] Autorecovering 1 storage domains >2014-08-24 10:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [67d60bc8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [9074b47] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [9074b47] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:40 AM >2014-08-24 10:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d8ed1aa >2014-08-24 10:40:22,722 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Attempting to update VMs/Templates Ovf. >2014-08-24 10:40:22,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Attempting to update VM OVFs in Data Center Default >2014-08-24 10:40:22,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Successfully updated VM OVFs in Data Center Default >2014-08-24 10:40:22,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Attempting to update template OVFs in Data Center Default >2014-08-24 10:40:22,726 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Successfully updated templates OVFs in Data Center Default >2014-08-24 10:40:22,726 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 10:40:22,727 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) [d805a56] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 10:42:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:42:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: d8ed1aa >2014-08-24 10:42:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:42:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:42:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3993c3c6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:42:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [9074b47] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:42 AM >2014-08-24 10:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [73a0a606] Autorecovering 1 storage domains >2014-08-24 10:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [73a0a606] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [7ed3054] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [7ed3054] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:45 AM >2014-08-24 10:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [60368570] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [60368570] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 52c52892 >2014-08-24 10:47:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [60368570] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:47:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [60368570] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 52c52892 >2014-08-24 10:47:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [60368570] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:47:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [60368570] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:47:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [60368570] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:47:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [7ed3054] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:47 AM >2014-08-24 10:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [59b48056] Autorecovering 1 storage domains >2014-08-24 10:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [59b48056] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [1808262c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [1808262c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:50 AM >2014-08-24 10:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [61183113] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [61183113] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3dbb112e >2014-08-24 10:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [61183113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [61183113] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3dbb112e >2014-08-24 10:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [61183113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [61183113] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [61183113] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [1808262c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:52 AM >2014-08-24 10:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [7ad110d0] Autorecovering 1 storage domains >2014-08-24 10:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [7ad110d0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 10:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7c789607] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 10:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7c789607] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:55 AM >2014-08-24 10:55:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 10:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 11f30a24 >2014-08-24 10:57:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 10:57:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 11f30a24 >2014-08-24 10:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 10:57:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 10:57:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [5a77e7b8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 10:57:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [7c789607] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:57 AM >2014-08-24 11:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [36e64559] Autorecovering 1 storage domains >2014-08-24 11:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [36e64559] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [72746e09] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [72746e09] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:00 AM >2014-08-24 11:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [59c97339] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [59c97339] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b6926ff >2014-08-24 11:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [59c97339] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:02:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [59c97339] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7b6926ff >2014-08-24 11:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [59c97339] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:02:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [59c97339] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [59c97339] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:02:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [72746e09] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:02 AM >2014-08-24 11:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [6364e258] Autorecovering 1 storage domains >2014-08-24 11:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [6364e258] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [2ff93dee] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [2ff93dee] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:05 AM >2014-08-24 11:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:05:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6eed15e2 >2014-08-24 11:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6eed15e2 >2014-08-24 11:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [75fbe37b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:07:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [2ff93dee] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:07 AM >2014-08-24 11:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [6111b6cf] Autorecovering 1 storage domains >2014-08-24 11:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [6111b6cf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [4dded307] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [4dded307] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:10 AM >2014-08-24 11:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7ade40bb >2014-08-24 11:12:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:12:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7ade40bb >2014-08-24 11:12:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:12:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [10f20bc4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:12:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [4dded307] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:12 AM >2014-08-24 11:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [4ed1230f] Autorecovering 1 storage domains >2014-08-24 11:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-18) [4ed1230f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [45622886] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [45622886] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:15 AM >2014-08-24 11:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [46dd5236] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [46dd5236] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6c3f736a >2014-08-24 11:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [46dd5236] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [46dd5236] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6c3f736a >2014-08-24 11:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [46dd5236] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [46dd5236] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [46dd5236] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:17:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-18) [45622886] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:17 AM >2014-08-24 11:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [679374e8] Autorecovering 1 storage domains >2014-08-24 11:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [679374e8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3ffae007] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3ffae007] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:20 AM >2014-08-24 11:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79ecbde5 >2014-08-24 11:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:22:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79ecbde5 >2014-08-24 11:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [1ea848e6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3ffae007] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:22 AM >2014-08-24 11:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [7413ada9] Autorecovering 1 storage domains >2014-08-24 11:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [7413ada9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [d0bf436] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [d0bf436] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:25 AM >2014-08-24 11:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [182abc58] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [182abc58] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4c0ea3c0 >2014-08-24 11:27:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [182abc58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:27:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [182abc58] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4c0ea3c0 >2014-08-24 11:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [182abc58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [182abc58] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [182abc58] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:27:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [d0bf436] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:27 AM >2014-08-24 11:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [812142a] Autorecovering 1 storage domains >2014-08-24 11:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [812142a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5519aa38] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5519aa38] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:30 AM >2014-08-24 11:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [25102891] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [25102891] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3ab43b81 >2014-08-24 11:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [25102891] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [25102891] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3ab43b81 >2014-08-24 11:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [25102891] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [25102891] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:32:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [25102891] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:32:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5519aa38] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:32 AM >2014-08-24 11:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [db9bb8b] Autorecovering 1 storage domains >2014-08-24 11:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-9) [db9bb8b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [7e6590f3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [7e6590f3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:35 AM >2014-08-24 11:35:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [730b5f09] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [730b5f09] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5eb96b58 >2014-08-24 11:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [730b5f09] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:37:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [730b5f09] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5eb96b58 >2014-08-24 11:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [730b5f09] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:37:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [730b5f09] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [730b5f09] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:37:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-9) [7e6590f3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:37 AM >2014-08-24 11:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [2934b930] Autorecovering 1 storage domains >2014-08-24 11:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [2934b930] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [7d8a1070] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [7d8a1070] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:40 AM >2014-08-24 11:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 138eef11 >2014-08-24 11:40:22,727 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Attempting to update VMs/Templates Ovf. >2014-08-24 11:40:22,728 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Attempting to update VM OVFs in Data Center Default >2014-08-24 11:40:22,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Successfully updated VM OVFs in Data Center Default >2014-08-24 11:40:22,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Attempting to update template OVFs in Data Center Default >2014-08-24 11:40:22,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Successfully updated templates OVFs in Data Center Default >2014-08-24 11:40:22,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 11:40:22,732 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 11:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 138eef11 >2014-08-24 11:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1daa7b5e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [7d8a1070] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:42 AM >2014-08-24 11:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Autorecovering 1 storage domains >2014-08-24 11:45:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [1dcff4c5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:45:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [3f8a6a8e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:45:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [3f8a6a8e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:45 AM >2014-08-24 11:45:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [319315ac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:45:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [319315ac] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41845a3c >2014-08-24 11:47:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [319315ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:47:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [319315ac] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41845a3c >2014-08-24 11:47:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [319315ac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-10) [319315ac] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:47:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [319315ac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:47:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [3f8a6a8e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:47 AM >2014-08-24 11:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [2ef788d6] Autorecovering 1 storage domains >2014-08-24 11:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [2ef788d6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [53ba728e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [53ba728e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:50 AM >2014-08-24 11:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [152dea1f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [152dea1f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ae4ab0f >2014-08-24 11:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [152dea1f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:52:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [152dea1f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ae4ab0f >2014-08-24 11:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [152dea1f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [152dea1f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [152dea1f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:52:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [53ba728e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:52 AM >2014-08-24 11:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [4f72ed84] Autorecovering 1 storage domains >2014-08-24 11:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [4f72ed84] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 11:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1e18da29] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 11:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1e18da29] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:55 AM >2014-08-24 11:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [8d5a781] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 11:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [8d5a781] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: fa235f3 >2014-08-24 11:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [8d5a781] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 11:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [8d5a781] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: fa235f3 >2014-08-24 11:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [8d5a781] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 11:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [8d5a781] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 11:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [8d5a781] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 11:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1e18da29] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:57 AM >2014-08-24 11:59:46,382 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 12:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Autorecovering 1 storage domains >2014-08-24 12:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [2ee3f3a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4b4909cf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4b4909cf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:00 PM >2014-08-24 12:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [5364254d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5364254d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33af93cf >2014-08-24 12:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [5364254d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:02:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [5364254d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33af93cf >2014-08-24 12:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [5364254d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:02:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [5364254d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:02:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [5364254d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:02:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4b4909cf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:02 PM >2014-08-24 12:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [1f9f2f6] Autorecovering 1 storage domains >2014-08-24 12:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [1f9f2f6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [68a0b075] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [68a0b075] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:05 PM >2014-08-24 12:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [67bae006] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [67bae006] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 73739e4f >2014-08-24 12:07:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [67bae006] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [67bae006] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 73739e4f >2014-08-24 12:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [67bae006] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:07:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [67bae006] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [67bae006] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:07:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [68a0b075] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:07 PM >2014-08-24 12:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [5c81ce97] Autorecovering 1 storage domains >2014-08-24 12:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [5c81ce97] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [35789e6c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [35789e6c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:10 PM >2014-08-24 12:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ff551d2 >2014-08-24 12:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1ff551d2 >2014-08-24 12:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [2ac4ffa4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [35789e6c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:12 PM >2014-08-24 12:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [696c0695] Autorecovering 1 storage domains >2014-08-24 12:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [696c0695] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [549c2557] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [549c2557] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:15 PM >2014-08-24 12:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6245033 >2014-08-24 12:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6245033 >2014-08-24 12:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:17:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [1cee5e36] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:17:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [549c2557] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:17 PM >2014-08-24 12:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [53ba728e] Autorecovering 1 storage domains >2014-08-24 12:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [53ba728e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [25fcfb43] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [25fcfb43] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:20 PM >2014-08-24 12:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17d78fd1 >2014-08-24 12:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:22:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17d78fd1 >2014-08-24 12:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [34ec3e07] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:22:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [25fcfb43] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:22 PM >2014-08-24 12:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [71393e46] Autorecovering 1 storage domains >2014-08-24 12:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [71393e46] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [16ac8dc1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [16ac8dc1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:25 PM >2014-08-24 12:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [4497998] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [4497998] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b9c1a0e >2014-08-24 12:27:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [4497998] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:27:05,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [4497998] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5b9c1a0e >2014-08-24 12:27:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [4497998] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:27:05,126 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [4497998] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:27:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [4497998] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:27:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [16ac8dc1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:27 PM >2014-08-24 12:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [a9ac9fa] Autorecovering 1 storage domains >2014-08-24 12:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [a9ac9fa] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:30:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [64e4d842] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:30:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [64e4d842] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:30 PM >2014-08-24 12:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2fd9f435 >2014-08-24 12:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:32:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2fd9f435 >2014-08-24 12:32:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:32:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [7c2bc812] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:32:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [64e4d842] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:32 PM >2014-08-24 12:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [3489e885] Autorecovering 1 storage domains >2014-08-24 12:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [3489e885] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [1b080c2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:35:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [1b080c2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:35 PM >2014-08-24 12:35:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [71757334] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [71757334] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2c65233b >2014-08-24 12:37:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [71757334] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:37:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-10) [71757334] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2c65233b >2014-08-24 12:37:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) [71757334] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:37:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-10) [71757334] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:37:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-10) [71757334] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:37:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [1b080c2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:37 PM >2014-08-24 12:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [7be73929] Autorecovering 1 storage domains >2014-08-24 12:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [7be73929] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [4badadc1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [4badadc1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:40 PM >2014-08-24 12:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [61327297] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [61327297] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2a37af37 >2014-08-24 12:40:22,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Attempting to update VMs/Templates Ovf. >2014-08-24 12:40:22,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Attempting to update VM OVFs in Data Center Default >2014-08-24 12:40:22,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Successfully updated VM OVFs in Data Center Default >2014-08-24 12:40:22,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Attempting to update template OVFs in Data Center Default >2014-08-24 12:40:22,737 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Successfully updated templates OVFs in Data Center Default >2014-08-24 12:40:22,737 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 12:40:22,738 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 12:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [61327297] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [61327297] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2a37af37 >2014-08-24 12:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [61327297] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [61327297] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [61327297] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [4badadc1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:42 PM >2014-08-24 12:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [10f6754e] Autorecovering 1 storage domains >2014-08-24 12:45:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [10f6754e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:45:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7e4c7126] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:45 PM >2014-08-24 12:45:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [3183b053] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:45:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [3183b053] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e2f1038 >2014-08-24 12:47:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [3183b053] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:47:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [3183b053] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2e2f1038 >2014-08-24 12:47:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [3183b053] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:47:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [3183b053] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:47:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [3183b053] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:47:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7e4c7126] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:47 PM >2014-08-24 12:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [6373fd23] Autorecovering 1 storage domains >2014-08-24 12:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [6373fd23] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [52238912] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [52238912] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:50 PM >2014-08-24 12:50:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6edd6113] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:50:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6edd6113] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68838be8 >2014-08-24 12:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6edd6113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:52:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6edd6113] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68838be8 >2014-08-24 12:52:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6edd6113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [6edd6113] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:52:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6edd6113] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:52:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [52238912] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:52 PM >2014-08-24 12:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [35e33c62] Autorecovering 1 storage domains >2014-08-24 12:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [35e33c62] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 12:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [507be840] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 12:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [507be840] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 12:55 PM >2014-08-24 12:55:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [5c38a505] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 12:55:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5c38a505] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6dd1491a >2014-08-24 12:57:05,137 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [5c38a505] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 12:57:05,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5c38a505] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6dd1491a >2014-08-24 12:57:05,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [5c38a505] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 12:57:05,138 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [5c38a505] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 12:57:05,142 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [5c38a505] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 12:57:05,142 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [507be840] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 12:57 PM >2014-08-24 13:00:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [45609cd2] Autorecovering 1 storage domains >2014-08-24 13:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-85) [45609cd2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [b9368e7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [b9368e7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:00 PM >2014-08-24 13:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 75e76e6f >2014-08-24 13:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 75e76e6f >2014-08-24 13:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [7d8719fa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:02:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-85) [b9368e7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:02 PM >2014-08-24 13:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [16ac8dc1] Autorecovering 1 storage domains >2014-08-24 13:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [16ac8dc1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6cc03b54] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6cc03b54] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:05 PM >2014-08-24 13:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f5a9650 >2014-08-24 13:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:07:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6f5a9650 >2014-08-24 13:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:07:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [2d2e9e7f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6cc03b54] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:07 PM >2014-08-24 13:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [283b0371] Autorecovering 1 storage domains >2014-08-24 13:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [283b0371] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [53ce479b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [53ce479b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:10 PM >2014-08-24 13:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [4ccad215] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4ccad215] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e1a4501 >2014-08-24 13:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [4ccad215] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:12:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4ccad215] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6e1a4501 >2014-08-24 13:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [4ccad215] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [4ccad215] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [4ccad215] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:12:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [53ce479b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:12 PM >2014-08-24 13:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [18a65f6e] Autorecovering 1 storage domains >2014-08-24 13:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [18a65f6e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1405c492] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1405c492] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:15 PM >2014-08-24 13:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [48a719b8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [48a719b8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4b2a953a >2014-08-24 13:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [48a719b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [48a719b8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4b2a953a >2014-08-24 13:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [48a719b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [48a719b8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:17:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [48a719b8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:17:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1405c492] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:17 PM >2014-08-24 13:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [6fb4971] Autorecovering 1 storage domains >2014-08-24 13:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [6fb4971] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6b6144cd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6b6144cd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:20 PM >2014-08-24 13:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [49bbab51] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [49bbab51] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: e8d3cb2 >2014-08-24 13:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [49bbab51] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:22:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [49bbab51] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: e8d3cb2 >2014-08-24 13:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [49bbab51] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [49bbab51] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:22:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [49bbab51] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:22:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [6b6144cd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:22 PM >2014-08-24 13:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [19f2ab5b] Autorecovering 1 storage domains >2014-08-24 13:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [19f2ab5b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [54dca0b4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [54dca0b4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:25 PM >2014-08-24 13:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 594b9d73 >2014-08-24 13:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:27:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 594b9d73 >2014-08-24 13:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:27:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [1bdcf41e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [54dca0b4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:27 PM >2014-08-24 13:28:09,842 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 13:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [d908d8e] Autorecovering 1 storage domains >2014-08-24 13:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [d908d8e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [51d8098c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [51d8098c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:30 PM >2014-08-24 13:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 30367939 >2014-08-24 13:32:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:32:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 30367939 >2014-08-24 13:32:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:32:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:32:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [26af7b4b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:32:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [51d8098c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:32 PM >2014-08-24 13:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [7d8a1070] Autorecovering 1 storage domains >2014-08-24 13:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [7d8a1070] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [3bb5f92] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [3bb5f92] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:35 PM >2014-08-24 13:35:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [665469aa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:35:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [665469aa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6674c57b >2014-08-24 13:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [665469aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:37:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [665469aa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6674c57b >2014-08-24 13:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [665469aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:37:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [665469aa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [665469aa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [3bb5f92] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:37 PM >2014-08-24 13:39:16,599 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 13:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [9074b47] Autorecovering 1 storage domains >2014-08-24 13:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [9074b47] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [64c7ab3a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [64c7ab3a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:40 PM >2014-08-24 13:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [330c5931] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [330c5931] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 719ab52d >2014-08-24 13:40:22,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Attempting to update VMs/Templates Ovf. >2014-08-24 13:40:22,740 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Attempting to update VM OVFs in Data Center Default >2014-08-24 13:40:22,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Successfully updated VM OVFs in Data Center Default >2014-08-24 13:40:22,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Attempting to update template OVFs in Data Center Default >2014-08-24 13:40:22,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Successfully updated templates OVFs in Data Center Default >2014-08-24 13:40:22,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 13:40:22,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 13:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [330c5931] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [330c5931] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 719ab52d >2014-08-24 13:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [330c5931] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [330c5931] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [330c5931] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [64c7ab3a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:42 PM >2014-08-24 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [6827bdd3] Autorecovering 1 storage domains >2014-08-24 13:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [6827bdd3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [7d98518b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [7d98518b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:45 PM >2014-08-24 13:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 499d38f3 >2014-08-24 13:47:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:47:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 499d38f3 >2014-08-24 13:47:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:47:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:47:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [7ae4d469] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:47:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [7d98518b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:47 PM >2014-08-24 13:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [411da325] Autorecovering 1 storage domains >2014-08-24 13:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [411da325] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [27a046e4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [27a046e4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:50 PM >2014-08-24 13:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3a645796] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3a645796] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c62b0d4 >2014-08-24 13:50:53,504 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 13:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3a645796] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:52:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3a645796] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1c62b0d4 >2014-08-24 13:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3a645796] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:52:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [3a645796] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3a645796] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [27a046e4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:52 PM >2014-08-24 13:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Autorecovering 1 storage domains >2014-08-24 13:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [3b7f4ca8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 13:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [15f762db] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 13:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [15f762db] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 1:55 PM >2014-08-24 13:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 13:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 154675c0 >2014-08-24 13:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 13:57:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 154675c0 >2014-08-24 13:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 13:57:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 13:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [120d4c8e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 13:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [15f762db] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 1:57 PM >2014-08-24 14:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [6575c65d] Autorecovering 1 storage domains >2014-08-24 14:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [6575c65d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [3dc34145] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [3dc34145] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:00 PM >2014-08-24 14:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [7cc22699] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [7cc22699] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6def9262 >2014-08-24 14:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [7cc22699] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [7cc22699] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6def9262 >2014-08-24 14:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [7cc22699] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [7cc22699] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [7cc22699] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [3dc34145] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:02 PM >2014-08-24 14:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [35789e6c] Autorecovering 1 storage domains >2014-08-24 14:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [35789e6c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [15b81691] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [15b81691] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:05 PM >2014-08-24 14:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:05:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65db1e17 >2014-08-24 14:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65db1e17 >2014-08-24 14:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [20fbc6e2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:07:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [15b81691] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:07 PM >2014-08-24 14:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [55b309c2] Autorecovering 1 storage domains >2014-08-24 14:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-14) [55b309c2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4b3844a7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4b3844a7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:10 PM >2014-08-24 14:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d23331a >2014-08-24 14:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d23331a >2014-08-24 14:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:12:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [6cc593f6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-14) [4b3844a7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:12 PM >2014-08-24 14:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Autorecovering 1 storage domains >2014-08-24 14:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [1505ed1c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [ff9848c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [ff9848c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:15 PM >2014-08-24 14:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [73e893ee] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [73e893ee] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6428d4a7 >2014-08-24 14:17:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [73e893ee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:17:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [73e893ee] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6428d4a7 >2014-08-24 14:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [73e893ee] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:17:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [73e893ee] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [73e893ee] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:17:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [ff9848c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:17 PM >2014-08-24 14:19:25,620 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 14:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [27a046e4] Autorecovering 1 storage domains >2014-08-24 14:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [27a046e4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [203aa694] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [203aa694] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:20 PM >2014-08-24 14:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2655822b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2655822b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22027ae >2014-08-24 14:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2655822b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2655822b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 22027ae >2014-08-24 14:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2655822b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [2655822b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:22:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2655822b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:22:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [203aa694] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:22 PM >2014-08-24 14:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [5636d843] Autorecovering 1 storage domains >2014-08-24 14:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [5636d843] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [1ceca06b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [1ceca06b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:25 PM >2014-08-24 14:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [21973d7a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [21973d7a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69fed2aa >2014-08-24 14:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [21973d7a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:27:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [21973d7a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69fed2aa >2014-08-24 14:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [21973d7a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:27:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [21973d7a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [21973d7a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [1ceca06b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:27 PM >2014-08-24 14:28:31,204 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 14:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [3dc34145] Autorecovering 1 storage domains >2014-08-24 14:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [3dc34145] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [2a6514e8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [2a6514e8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:30 PM >2014-08-24 14:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [164247c6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [164247c6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: fb8d7f6 >2014-08-24 14:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [164247c6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [164247c6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: fb8d7f6 >2014-08-24 14:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [164247c6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [164247c6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [164247c6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [2a6514e8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:32 PM >2014-08-24 14:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [52238912] Autorecovering 1 storage domains >2014-08-24 14:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [52238912] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [227a4437] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [227a4437] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:35 PM >2014-08-24 14:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bd870e3 >2014-08-24 14:37:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:37:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7bd870e3 >2014-08-24 14:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:37:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [1e4a7e66] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:37:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [227a4437] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:37 PM >2014-08-24 14:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [507be840] Autorecovering 1 storage domains >2014-08-24 14:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-95) [507be840] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e70256] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e70256] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:40 PM >2014-08-24 14:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [58fb775f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [58fb775f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 369eae7e >2014-08-24 14:40:22,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Attempting to update VMs/Templates Ovf. >2014-08-24 14:40:22,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Attempting to update VM OVFs in Data Center Default >2014-08-24 14:40:22,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Successfully updated VM OVFs in Data Center Default >2014-08-24 14:40:22,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Attempting to update template OVFs in Data Center Default >2014-08-24 14:40:22,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Successfully updated templates OVFs in Data Center Default >2014-08-24 14:40:22,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 14:40:22,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) [15b81691] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 14:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [58fb775f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:42:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [58fb775f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 369eae7e >2014-08-24 14:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [58fb775f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [58fb775f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:42:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [58fb775f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:42:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-95) [3e70256] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:42 PM >2014-08-24 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [7dc0d9ba] Autorecovering 1 storage domains >2014-08-24 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [7dc0d9ba] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [c2f5adb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [c2f5adb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:45 PM >2014-08-24 14:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [37f8292d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [37f8292d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44e2a6f7 >2014-08-24 14:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [37f8292d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:47:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [37f8292d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 44e2a6f7 >2014-08-24 14:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [37f8292d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:47:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [37f8292d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [37f8292d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [c2f5adb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:47 PM >2014-08-24 14:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [29055a64] Autorecovering 1 storage domains >2014-08-24 14:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [29055a64] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [59ff2441] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [59ff2441] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:50 PM >2014-08-24 14:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 72d3455f >2014-08-24 14:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:52:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 72d3455f >2014-08-24 14:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [87a1ffd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:52:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [59ff2441] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:52 PM >2014-08-24 14:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [5bd1311e] Autorecovering 1 storage domains >2014-08-24 14:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-35) [5bd1311e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 14:55:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [789fbb03] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 14:55:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [789fbb03] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 2:55 PM >2014-08-24 14:55:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [44d3780b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 14:55:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [44d3780b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 28f8e5fc >2014-08-24 14:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [44d3780b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 14:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [44d3780b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 28f8e5fc >2014-08-24 14:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [44d3780b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 14:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [44d3780b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 14:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [44d3780b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 14:57:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-35) [789fbb03] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 2:57 PM >2014-08-24 14:57:18,615 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 15:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [7ed3054] Autorecovering 1 storage domains >2014-08-24 15:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [7ed3054] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78116e4e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78116e4e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:00 PM >2014-08-24 15:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [25658c11] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:00:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [25658c11] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7bdec087 >2014-08-24 15:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [25658c11] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:02:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [25658c11] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7bdec087 >2014-08-24 15:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [25658c11] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:02:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [25658c11] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [25658c11] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:02:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78116e4e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:02 PM >2014-08-24 15:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [1f7a3933] Autorecovering 1 storage domains >2014-08-24 15:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [1f7a3933] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [7b9856dc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [7b9856dc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:05 PM >2014-08-24 15:05:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:05:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 64af335a >2014-08-24 15:07:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:07:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 64af335a >2014-08-24 15:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:07:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:07:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [5a0afed6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:07:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [7b9856dc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:07 PM >2014-08-24 15:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [72e7f0ad] Autorecovering 1 storage domains >2014-08-24 15:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [72e7f0ad] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [1dc8566a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [1dc8566a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:10 PM >2014-08-24 15:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [40e44567] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [40e44567] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68d15897 >2014-08-24 15:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [40e44567] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:12:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [40e44567] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68d15897 >2014-08-24 15:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [40e44567] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [40e44567] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [40e44567] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:12:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [1dc8566a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:12 PM >2014-08-24 15:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [227a4437] Autorecovering 1 storage domains >2014-08-24 15:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [227a4437] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [38bd07f0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [38bd07f0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:15 PM >2014-08-24 15:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [43450363] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [43450363] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 144147ef >2014-08-24 15:17:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [43450363] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:17:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [43450363] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 144147ef >2014-08-24 15:17:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [43450363] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:17:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [43450363] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:17:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [43450363] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:17:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [38bd07f0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:17 PM >2014-08-24 15:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [5b15d145] Autorecovering 1 storage domains >2014-08-24 15:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-91) [5b15d145] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [118d5aca] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [118d5aca] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:20 PM >2014-08-24 15:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:20:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d6ae8a0 >2014-08-24 15:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d6ae8a0 >2014-08-24 15:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [37a7ace6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:22:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-91) [118d5aca] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:22 PM >2014-08-24 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [5fc5f3f0] Autorecovering 1 storage domains >2014-08-24 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [5fc5f3f0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [3b117574] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [3b117574] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:25 PM >2014-08-24 15:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 799fa919 >2014-08-24 15:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:27:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 799fa919 >2014-08-24 15:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:27:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [6c07cbf2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [3b117574] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:27 PM >2014-08-24 15:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [3bb5f92] Autorecovering 1 storage domains >2014-08-24 15:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [3bb5f92] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [31baaae8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [31baaae8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:30 PM >2014-08-24 15:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [21b4853d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [21b4853d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f8c422f >2014-08-24 15:32:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [21b4853d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:32:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [21b4853d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6f8c422f >2014-08-24 15:32:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [21b4853d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:32:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [21b4853d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:32:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [21b4853d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:32:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [31baaae8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:32 PM >2014-08-24 15:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [3192aaf3] Autorecovering 1 storage domains >2014-08-24 15:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [3192aaf3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3bb19308] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3bb19308] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:35 PM >2014-08-24 15:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [cf56dce] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [cf56dce] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 49756f79 >2014-08-24 15:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [cf56dce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:37:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [cf56dce] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 49756f79 >2014-08-24 15:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [cf56dce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [cf56dce] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:37:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [cf56dce] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:37:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [3bb19308] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:37 PM >2014-08-24 15:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [7d98518b] Autorecovering 1 storage domains >2014-08-24 15:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [7d98518b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [4a628730] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [4a628730] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:40 PM >2014-08-24 15:40:00,029 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:40:00,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 8b0c1fa >2014-08-24 15:40:22,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Attempting to update VMs/Templates Ovf. >2014-08-24 15:40:22,751 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Attempting to update VM OVFs in Data Center Default >2014-08-24 15:40:22,753 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Successfully updated VM OVFs in Data Center Default >2014-08-24 15:40:22,753 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Attempting to update template OVFs in Data Center Default >2014-08-24 15:40:22,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Successfully updated templates OVFs in Data Center Default >2014-08-24 15:40:22,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 15:40:22,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 15:42:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:42:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 8b0c1fa >2014-08-24 15:42:05,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:42:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:42:05,123 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [55a2fc91] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:42:05,123 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [4a628730] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:42 PM >2014-08-24 15:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Autorecovering 1 storage domains >2014-08-24 15:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7e4c7126] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7be1a76d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7be1a76d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:45 PM >2014-08-24 15:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [78b72c29] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [78b72c29] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 55beee77 >2014-08-24 15:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [78b72c29] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:47:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [78b72c29] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 55beee77 >2014-08-24 15:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [78b72c29] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:47:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [78b72c29] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:47:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [78b72c29] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:47:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [7be1a76d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:47 PM >2014-08-24 15:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [15b81691] Autorecovering 1 storage domains >2014-08-24 15:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-96) [15b81691] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [8986d38] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [8986d38] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:50 PM >2014-08-24 15:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [4f862510] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4f862510] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 490b692d >2014-08-24 15:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [4f862510] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [4f862510] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 490b692d >2014-08-24 15:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [4f862510] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [4f862510] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:52:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [4f862510] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:52:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-96) [8986d38] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:52 PM >2014-08-24 15:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [778cb0d5] Autorecovering 1 storage domains >2014-08-24 15:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [778cb0d5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 15:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [2e15cdb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 15:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [2e15cdb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 3:55 PM >2014-08-24 15:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 15:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 512472b0 >2014-08-24 15:57:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 15:57:05,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 512472b0 >2014-08-24 15:57:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 15:57:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 15:57:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [57b9e6d1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 15:57:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [2e15cdb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 3:57 PM >2014-08-24 16:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [ff9848c] Autorecovering 1 storage domains >2014-08-24 16:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [ff9848c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [a9fa5e9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [a9fa5e9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:00 PM >2014-08-24 16:00:00,024 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [51720c59] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:00:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [51720c59] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f2b1d2e >2014-08-24 16:02:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [51720c59] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:02:05,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [51720c59] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f2b1d2e >2014-08-24 16:02:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [51720c59] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:02:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [51720c59] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:02:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [51720c59] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:02:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [a9fa5e9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:02 PM >2014-08-24 16:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [3ceff859] Autorecovering 1 storage domains >2014-08-24 16:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [3ceff859] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ccf80aa] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ccf80aa] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:05 PM >2014-08-24 16:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [44ed7823] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [44ed7823] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 30e3f452 >2014-08-24 16:07:05,159 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [44ed7823] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:07:05,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [44ed7823] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 30e3f452 >2014-08-24 16:07:05,160 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [44ed7823] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:07:05,160 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [44ed7823] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:07:05,165 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [44ed7823] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:07:05,165 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ccf80aa] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:07 PM >2014-08-24 16:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [77bca3a0] Autorecovering 1 storage domains >2014-08-24 16:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [77bca3a0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [795b2a8c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [795b2a8c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:10 PM >2014-08-24 16:10:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [188cd99f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [188cd99f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 179a8878 >2014-08-24 16:12:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [188cd99f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:12:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [188cd99f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 179a8878 >2014-08-24 16:12:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [188cd99f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:12:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [188cd99f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:12:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [188cd99f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:12:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [795b2a8c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:12 PM >2014-08-24 16:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Autorecovering 1 storage domains >2014-08-24 16:15:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [77ec1ea9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:15:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [5e26c0d7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:15:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [5e26c0d7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:15 PM >2014-08-24 16:15:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [19182113] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:15:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [19182113] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6be6f16e >2014-08-24 16:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [19182113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:17:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [19182113] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6be6f16e >2014-08-24 16:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [19182113] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [19182113] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [19182113] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:17:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [5e26c0d7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:17 PM >2014-08-24 16:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [5df2a436] Autorecovering 1 storage domains >2014-08-24 16:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [5df2a436] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [378fe4bc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [378fe4bc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:20 PM >2014-08-24 16:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 631f6c04 >2014-08-24 16:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 631f6c04 >2014-08-24 16:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [1f3dded5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [378fe4bc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:22 PM >2014-08-24 16:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [34584623] Autorecovering 1 storage domains >2014-08-24 16:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [34584623] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [379ab1ed] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [379ab1ed] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:25 PM >2014-08-24 16:25:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [3c698168] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:25:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [3c698168] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1e2c928f >2014-08-24 16:27:05,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [3c698168] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:27:05,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [3c698168] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1e2c928f >2014-08-24 16:27:05,146 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [3c698168] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:27:05,146 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [3c698168] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:27:05,151 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [3c698168] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:27:05,151 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [379ab1ed] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:27 PM >2014-08-24 16:28:43,965 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 16:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [6a418887] Autorecovering 1 storage domains >2014-08-24 16:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [6a418887] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:30:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [4aa3a5bd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:30:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [4aa3a5bd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:30 PM >2014-08-24 16:30:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [8d4b854] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:30:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [8d4b854] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 289216ac >2014-08-24 16:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [8d4b854] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [8d4b854] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 289216ac >2014-08-24 16:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [8d4b854] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [8d4b854] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [8d4b854] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [4aa3a5bd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:32 PM >2014-08-24 16:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [60f52d16] Autorecovering 1 storage domains >2014-08-24 16:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [60f52d16] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1c93c07e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1c93c07e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:35 PM >2014-08-24 16:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [35db43ce] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [35db43ce] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65f017c7 >2014-08-24 16:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [35db43ce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:37:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [35db43ce] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65f017c7 >2014-08-24 16:37:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [35db43ce] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:37:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [35db43ce] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:37:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [35db43ce] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:37:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1c93c07e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:37 PM >2014-08-24 16:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [37a44805] Autorecovering 1 storage domains >2014-08-24 16:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [37a44805] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [7320fe81] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [7320fe81] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:40 PM >2014-08-24 16:40:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [67849f7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:40:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [67849f7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: dae8b0c >2014-08-24 16:40:22,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Attempting to update VMs/Templates Ovf. >2014-08-24 16:40:22,756 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Attempting to update VM OVFs in Data Center Default >2014-08-24 16:40:22,758 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Successfully updated VM OVFs in Data Center Default >2014-08-24 16:40:22,758 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Attempting to update template OVFs in Data Center Default >2014-08-24 16:40:22,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Successfully updated templates OVFs in Data Center Default >2014-08-24 16:40:22,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 16:40:22,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) [162febe5] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 16:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [67849f7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [67849f7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: dae8b0c >2014-08-24 16:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [67849f7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-26) [67849f7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-26) [67849f7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:42:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [7320fe81] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:42 PM >2014-08-24 16:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [ccf80aa] Autorecovering 1 storage domains >2014-08-24 16:45:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [ccf80aa] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:45:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ec337eb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ec337eb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:45 PM >2014-08-24 16:45:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [775480cc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:45:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [775480cc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 179a7972 >2014-08-24 16:47:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [775480cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:47:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [775480cc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 179a7972 >2014-08-24 16:47:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [775480cc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:47:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [775480cc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:47:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [775480cc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:47:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [ec337eb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:47 PM >2014-08-24 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [64c7ab3a] Autorecovering 1 storage domains >2014-08-24 16:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [64c7ab3a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [46a1968d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [46a1968d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:50 PM >2014-08-24 16:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b4bfe64 >2014-08-24 16:52:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:52:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6b4bfe64 >2014-08-24 16:52:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:52:05,116 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:52:05,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4ade6b6c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:52:05,121 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [46a1968d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:52 PM >2014-08-24 16:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [1dc8566a] Autorecovering 1 storage domains >2014-08-24 16:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [1dc8566a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 16:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [195b5629] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 16:55:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [195b5629] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 4:55 PM >2014-08-24 16:55:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [25f913cf] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 16:55:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [25f913cf] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 307f1a6e >2014-08-24 16:57:05,134 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [25f913cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 16:57:05,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [25f913cf] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 307f1a6e >2014-08-24 16:57:05,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [25f913cf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 16:57:05,135 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [25f913cf] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 16:57:05,140 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [25f913cf] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 16:57:05,140 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [195b5629] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 4:57 PM >2014-08-24 17:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [4c4681b] Autorecovering 1 storage domains >2014-08-24 17:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [4c4681b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [130b3ead] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [130b3ead] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:00 PM >2014-08-24 17:00:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:00:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 511a9e4e >2014-08-24 17:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:02:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 511a9e4e >2014-08-24 17:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:02:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [2b3a9971] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:02:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [130b3ead] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:02 PM >2014-08-24 17:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [4badadc1] Autorecovering 1 storage domains >2014-08-24 17:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [4badadc1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [1554574b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [1554574b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:05 PM >2014-08-24 17:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 42c1dfde >2014-08-24 17:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:07:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 42c1dfde >2014-08-24 17:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:07:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [6e3b5dac] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:07:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [1554574b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:07 PM >2014-08-24 17:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [12bd47ea] Autorecovering 1 storage domains >2014-08-24 17:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [12bd47ea] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [6e5e4d07] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [6e5e4d07] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:10 PM >2014-08-24 17:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3a3df620] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3a3df620] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 198f6639 >2014-08-24 17:12:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3a3df620] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:12:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3a3df620] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 198f6639 >2014-08-24 17:12:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3a3df620] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:12:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [3a3df620] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:12:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3a3df620] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:12:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [6e5e4d07] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:12 PM >2014-08-24 17:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [31baaae8] Autorecovering 1 storage domains >2014-08-24 17:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [31baaae8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6a811321] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6a811321] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:15 PM >2014-08-24 17:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2dbb8a72 >2014-08-24 17:17:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:17:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2dbb8a72 >2014-08-24 17:17:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:17:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:17:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [476c1d1a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:17:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [6a811321] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:17 PM >2014-08-24 17:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [444c0071] Autorecovering 1 storage domains >2014-08-24 17:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-54) [444c0071] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [412d776b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [412d776b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:20 PM >2014-08-24 17:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d2b8bbf >2014-08-24 17:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d2b8bbf >2014-08-24 17:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [3d4adfe3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-54) [412d776b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:22 PM >2014-08-24 17:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [53ce479b] Autorecovering 1 storage domains >2014-08-24 17:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [53ce479b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [4111c595] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [4111c595] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:25 PM >2014-08-24 17:25:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:25:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 54852ff5 >2014-08-24 17:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 54852ff5 >2014-08-24 17:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [4cf8f73] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:27:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [4111c595] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:27 PM >2014-08-24 17:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7be1a76d] Autorecovering 1 storage domains >2014-08-24 17:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [7be1a76d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [378e0435] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [378e0435] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:30 PM >2014-08-24 17:30:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [56107b4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:30:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [56107b4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6419385a >2014-08-24 17:32:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [56107b4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:32:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [56107b4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6419385a >2014-08-24 17:32:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [56107b4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-20) [56107b4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:32:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-20) [56107b4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:32:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [378e0435] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:32 PM >2014-08-24 17:32:52,275 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 17:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Autorecovering 1 storage domains >2014-08-24 17:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [68eb4e03] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [40784e52] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [40784e52] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:35 PM >2014-08-24 17:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [54a91a74] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [54a91a74] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d171311 >2014-08-24 17:37:05,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [54a91a74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:37:05,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [54a91a74] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d171311 >2014-08-24 17:37:05,162 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [54a91a74] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:37:05,162 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [54a91a74] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:37:05,167 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [54a91a74] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:37:05,167 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [40784e52] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:37 PM >2014-08-24 17:40:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [6cc03b54] Autorecovering 1 storage domains >2014-08-24 17:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [6cc03b54] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:40:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2b0b99b0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:40:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2b0b99b0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:40 PM >2014-08-24 17:40:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [33db5430] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:40:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [33db5430] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 175fb968 >2014-08-24 17:40:22,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update VMs/Templates Ovf. >2014-08-24 17:40:22,762 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update VM OVFs in Data Center Default >2014-08-24 17:40:22,763 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully updated VM OVFs in Data Center Default >2014-08-24 17:40:22,763 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update template OVFs in Data Center Default >2014-08-24 17:40:22,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully updated templates OVFs in Data Center Default >2014-08-24 17:40:22,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 17:40:22,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 17:42:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [33db5430] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:42:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [33db5430] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 175fb968 >2014-08-24 17:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [33db5430] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:42:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [33db5430] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [33db5430] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:42:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [2b0b99b0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:42 PM >2014-08-24 17:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [a9fa5e9] Autorecovering 1 storage domains >2014-08-24 17:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [a9fa5e9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [649afd7d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [649afd7d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:45 PM >2014-08-24 17:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1697eb78] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1697eb78] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1079d694 >2014-08-24 17:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1697eb78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:47:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1697eb78] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1079d694 >2014-08-24 17:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1697eb78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [1697eb78] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:47:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1697eb78] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:47:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [649afd7d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:47 PM >2014-08-24 17:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [25fcfb43] Autorecovering 1 storage domains >2014-08-24 17:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-51) [25fcfb43] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [537a6a15] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [537a6a15] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:50 PM >2014-08-24 17:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4366905f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4366905f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d60e3d5 >2014-08-24 17:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4366905f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:52:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [4366905f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: d60e3d5 >2014-08-24 17:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [4366905f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [4366905f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [4366905f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-51) [537a6a15] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:52 PM >2014-08-24 17:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [6a811321] Autorecovering 1 storage domains >2014-08-24 17:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [6a811321] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 17:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [755d650a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 17:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [755d650a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 5:55 PM >2014-08-24 17:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [7a56a401] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 17:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [7a56a401] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 789a8b31 >2014-08-24 17:57:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [7a56a401] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 17:57:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [7a56a401] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 789a8b31 >2014-08-24 17:57:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [7a56a401] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 17:57:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [7a56a401] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 17:57:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [7a56a401] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 17:57:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [755d650a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 5:57 PM >2014-08-24 18:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [59ff2441] Autorecovering 1 storage domains >2014-08-24 18:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [59ff2441] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [377ceb13] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [377ceb13] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:00 PM >2014-08-24 18:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [12daafdd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [12daafdd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e1cc966 >2014-08-24 18:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [12daafdd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:02:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [12daafdd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4e1cc966 >2014-08-24 18:02:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [12daafdd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [12daafdd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:02:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [12daafdd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:02:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [377ceb13] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:02 PM >2014-08-24 18:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [13379952] Autorecovering 1 storage domains >2014-08-24 18:05:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [13379952] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:05:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [4976802f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:05:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [4976802f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:05 PM >2014-08-24 18:05:00,037 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [45eff499] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:05:00,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [45eff499] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 263f38c3 >2014-08-24 18:07:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [45eff499] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:07:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [45eff499] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 263f38c3 >2014-08-24 18:07:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [45eff499] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:07:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [45eff499] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:07:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [45eff499] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:07:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [4976802f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:07 PM >2014-08-24 18:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [15f762db] Autorecovering 1 storage domains >2014-08-24 18:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [15f762db] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [c7f7289] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [c7f7289] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:10 PM >2014-08-24 18:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f80055c >2014-08-24 18:12:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:12:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6f80055c >2014-08-24 18:12:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:12:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:12:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [2be7e62e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:12:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [c7f7289] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:12 PM >2014-08-24 18:14:32,099 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 18:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [7b9856dc] Autorecovering 1 storage domains >2014-08-24 18:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [7b9856dc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [676b4c9c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [676b4c9c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:15 PM >2014-08-24 18:15:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:15:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6ef822d >2014-08-24 18:17:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:17:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6ef822d >2014-08-24 18:17:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:17:05,129 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:17:05,133 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [5cacebb3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:17:05,133 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [676b4c9c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:17 PM >2014-08-24 18:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [3153303c] Autorecovering 1 storage domains >2014-08-24 18:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [3153303c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [a6e2f58] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [a6e2f58] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:20 PM >2014-08-24 18:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 460b0b12 >2014-08-24 18:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:22:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 460b0b12 >2014-08-24 18:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:22:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [1f38e8e6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:22:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [a6e2f58] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:22 PM >2014-08-24 18:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [38bd07f0] Autorecovering 1 storage domains >2014-08-24 18:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-69) [38bd07f0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [7024a8d7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [7024a8d7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:25 PM >2014-08-24 18:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [21365a49] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [21365a49] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 75cece74 >2014-08-24 18:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [21365a49] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:27:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [21365a49] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 75cece74 >2014-08-24 18:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [21365a49] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [21365a49] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [21365a49] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:27:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-69) [7024a8d7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:27 PM >2014-08-24 18:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [ec337eb] Autorecovering 1 storage domains >2014-08-24 18:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [ec337eb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [1825150a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [1825150a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:30 PM >2014-08-24 18:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [2c747955] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2c747955] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3ad584f1 >2014-08-24 18:32:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [2c747955] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:32:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2c747955] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3ad584f1 >2014-08-24 18:32:05,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [2c747955] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:32:05,133 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [2c747955] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:32:05,137 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [2c747955] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:32:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [1825150a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:32 PM >2014-08-24 18:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [5519aa38] Autorecovering 1 storage domains >2014-08-24 18:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [5519aa38] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [4760417b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [4760417b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:35 PM >2014-08-24 18:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [403d11c5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [403d11c5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 23a53df4 >2014-08-24 18:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [403d11c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:37:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-23) [403d11c5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 23a53df4 >2014-08-24 18:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-23) [403d11c5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-23) [403d11c5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-23) [403d11c5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:37:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [4760417b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:37 PM >2014-08-24 18:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [68a0b075] Autorecovering 1 storage domains >2014-08-24 18:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [68a0b075] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [53803f78] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [53803f78] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:40 PM >2014-08-24 18:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [32941177] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [32941177] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16663de7 >2014-08-24 18:40:22,766 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Attempting to update VMs/Templates Ovf. >2014-08-24 18:40:22,767 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Attempting to update VM OVFs in Data Center Default >2014-08-24 18:40:22,769 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Successfully updated VM OVFs in Data Center Default >2014-08-24 18:40:22,769 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Attempting to update template OVFs in Data Center Default >2014-08-24 18:40:22,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Successfully updated templates OVFs in Data Center Default >2014-08-24 18:40:22,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 18:40:22,771 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) [755d650a] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 18:42:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [32941177] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:42:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [32941177] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 16663de7 >2014-08-24 18:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [32941177] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:42:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [32941177] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [32941177] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [53803f78] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:42 PM >2014-08-24 18:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [9e07b3d] Autorecovering 1 storage domains >2014-08-24 18:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [9e07b3d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6eb076ff] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6eb076ff] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:45 PM >2014-08-24 18:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:45:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4bccc99d >2014-08-24 18:47:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:47:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4bccc99d >2014-08-24 18:47:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:47:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:47:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1d7ca040] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:47:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [6eb076ff] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:47 PM >2014-08-24 18:47:21,927 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 18:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [c7f7289] Autorecovering 1 storage domains >2014-08-24 18:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [c7f7289] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3c62d813] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3c62d813] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:50 PM >2014-08-24 18:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [85443e5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [85443e5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4e982d8e >2014-08-24 18:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [85443e5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [85443e5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4e982d8e >2014-08-24 18:52:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [85443e5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [85443e5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:52:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [85443e5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:52:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [3c62d813] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:52 PM >2014-08-24 18:53:25,544 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 18:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [2e15cdb] Autorecovering 1 storage domains >2014-08-24 18:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [2e15cdb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 18:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [581ad026] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 18:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [581ad026] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 6:55 PM >2014-08-24 18:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [3450c567] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 18:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [3450c567] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: eb71a19 >2014-08-24 18:57:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [3450c567] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 18:57:05,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [3450c567] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: eb71a19 >2014-08-24 18:57:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [3450c567] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 18:57:05,126 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [3450c567] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 18:57:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [3450c567] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 18:57:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [581ad026] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 6:57 PM >2014-08-24 19:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [d805a56] Autorecovering 1 storage domains >2014-08-24 19:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [d805a56] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [4170ba40] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [4170ba40] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:00 PM >2014-08-24 19:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f479572 >2014-08-24 19:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:02:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f479572 >2014-08-24 19:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:02:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [165f4aa0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:02:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [4170ba40] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:02 PM >2014-08-24 19:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [6e5e4d07] Autorecovering 1 storage domains >2014-08-24 19:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [6e5e4d07] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:05 PM >2014-08-24 19:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [e2cca31] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [e2cca31] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 763600c3 >2014-08-24 19:07:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [e2cca31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:07:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [e2cca31] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 763600c3 >2014-08-24 19:07:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [e2cca31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:07:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [e2cca31] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:07:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [e2cca31] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:07:05,124 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:07 PM >2014-08-24 19:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [53803f78] Autorecovering 1 storage domains >2014-08-24 19:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [53803f78] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [132236a7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [132236a7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:10 PM >2014-08-24 19:10:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41afbd2c >2014-08-24 19:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:12:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41afbd2c >2014-08-24 19:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:12:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [6f1ee037] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:12:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [132236a7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:12 PM >2014-08-24 19:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [378e0435] Autorecovering 1 storage domains >2014-08-24 19:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [378e0435] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [47f88330] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [47f88330] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:15 PM >2014-08-24 19:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 49dbc08 >2014-08-24 19:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:17:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 49dbc08 >2014-08-24 19:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [195f3fe1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:17:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [47f88330] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:17 PM >2014-08-24 19:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [1b080c2] Autorecovering 1 storage domains >2014-08-24 19:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [1b080c2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [6c8643e2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [6c8643e2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:20 PM >2014-08-24 19:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [617b1d16] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [617b1d16] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1f74c382 >2014-08-24 19:22:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [617b1d16] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:22:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [617b1d16] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1f74c382 >2014-08-24 19:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [617b1d16] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [617b1d16] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:22:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [617b1d16] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:22:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [6c8643e2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:22 PM >2014-08-24 19:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [6eb076ff] Autorecovering 1 storage domains >2014-08-24 19:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [6eb076ff] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7212c054] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7212c054] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:25 PM >2014-08-24 19:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [39158f5d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [39158f5d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 29a4e87b >2014-08-24 19:27:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [39158f5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:27:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [39158f5d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 29a4e87b >2014-08-24 19:27:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [39158f5d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:27:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [39158f5d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:27:05,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [39158f5d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:27:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [7212c054] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:27 PM >2014-08-24 19:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1405c492] Autorecovering 1 storage domains >2014-08-24 19:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1405c492] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [679b31a3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [679b31a3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:30 PM >2014-08-24 19:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [6eab7604] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [6eab7604] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2628dd07 >2014-08-24 19:32:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [6eab7604] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:32:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [6eab7604] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2628dd07 >2014-08-24 19:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [6eab7604] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:32:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [6eab7604] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:32:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [6eab7604] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:32:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [679b31a3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:32 PM >2014-08-24 19:35:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [1e18da29] Autorecovering 1 storage domains >2014-08-24 19:35:00,015 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [1e18da29] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:35:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [63293ecf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:35:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [63293ecf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:35 PM >2014-08-24 19:35:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [7a92298d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:35:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [7a92298d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6337265a >2014-08-24 19:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [7a92298d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:37:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [7a92298d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6337265a >2014-08-24 19:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [7a92298d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:37:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [7a92298d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:37:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [7a92298d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:37:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [63293ecf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:37 PM >2014-08-24 19:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [203aa694] Autorecovering 1 storage domains >2014-08-24 19:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [203aa694] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [18db71fe] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [18db71fe] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:40 PM >2014-08-24 19:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [2ff40059] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [2ff40059] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 14bd0c89 >2014-08-24 19:40:22,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Attempting to update VMs/Templates Ovf. >2014-08-24 19:40:22,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Attempting to update VM OVFs in Data Center Default >2014-08-24 19:40:22,774 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Successfully updated VM OVFs in Data Center Default >2014-08-24 19:40:22,775 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Attempting to update template OVFs in Data Center Default >2014-08-24 19:40:22,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Successfully updated templates OVFs in Data Center Default >2014-08-24 19:40:22,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 19:40:22,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 19:41:54,709 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 19:42:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [2ff40059] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:42:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [2ff40059] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 14bd0c89 >2014-08-24 19:42:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [2ff40059] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:42:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [2ff40059] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:42:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [2ff40059] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:42:05,129 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [18db71fe] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:42 PM >2014-08-24 19:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [442b46a8] Autorecovering 1 storage domains >2014-08-24 19:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [442b46a8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [53c92f92] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [53c92f92] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:45 PM >2014-08-24 19:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79cd595e >2014-08-24 19:47:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:47:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79cd595e >2014-08-24 19:47:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:47:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:47:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7907cf8d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:47:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [53c92f92] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:47 PM >2014-08-24 19:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [132236a7] Autorecovering 1 storage domains >2014-08-24 19:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [132236a7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [46f1ba62] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [46f1ba62] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:50 PM >2014-08-24 19:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4fda95da] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4fda95da] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: f641279 >2014-08-24 19:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4fda95da] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [4fda95da] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: f641279 >2014-08-24 19:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [4fda95da] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [4fda95da] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [4fda95da] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [46f1ba62] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:52 PM >2014-08-24 19:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [4a628730] Autorecovering 1 storage domains >2014-08-24 19:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-27) [4a628730] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 19:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [5e9dd0fb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 19:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [5e9dd0fb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 7:55 PM >2014-08-24 19:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 19:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 12591277 >2014-08-24 19:57:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 19:57:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 12591277 >2014-08-24 19:57:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 19:57:05,126 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 19:57:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [7ece6cb3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 19:57:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-27) [5e9dd0fb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 7:57 PM >2014-08-24 20:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [676b4c9c] Autorecovering 1 storage domains >2014-08-24 20:00:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [676b4c9c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [143b6996] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [143b6996] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:00 PM >2014-08-24 20:00:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [46383391] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [46383391] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d90f836 >2014-08-24 20:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [46383391] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:02:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [46383391] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d90f836 >2014-08-24 20:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [46383391] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [46383391] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [46383391] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:02:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [143b6996] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:02 PM >2014-08-24 20:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [6b6144cd] Autorecovering 1 storage domains >2014-08-24 20:05:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [6b6144cd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:05:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [5d3edabe] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:05:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [5d3edabe] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:05 PM >2014-08-24 20:05:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:05:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a7687c2 >2014-08-24 20:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7a7687c2 >2014-08-24 20:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:07:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [5a42d63b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [5d3edabe] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:07 PM >2014-08-24 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [679b31a3] Autorecovering 1 storage domains >2014-08-24 20:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [679b31a3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [39975e0a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [39975e0a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:10 PM >2014-08-24 20:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [20e15bab] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:10:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [20e15bab] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 543747f1 >2014-08-24 20:12:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [20e15bab] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:12:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [20e15bab] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 543747f1 >2014-08-24 20:12:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [20e15bab] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:12:05,116 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-27) [20e15bab] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:12:05,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [20e15bab] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:12:05,121 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [39975e0a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:12 PM >2014-08-24 20:15:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [63293ecf] Autorecovering 1 storage domains >2014-08-24 20:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [63293ecf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:15:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [5b82321a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:15:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [5b82321a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:15 PM >2014-08-24 20:15:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [76359590] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:15:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [76359590] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74aa4490 >2014-08-24 20:15:30,029 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 20:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [76359590] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [76359590] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 74aa4490 >2014-08-24 20:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [76359590] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [76359590] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:17:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [76359590] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:17:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [5b82321a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:17 PM >2014-08-24 20:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [46f1ba62] Autorecovering 1 storage domains >2014-08-24 20:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [46f1ba62] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [57921dee] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [57921dee] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:20 PM >2014-08-24 20:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6141fefc >2014-08-24 20:22:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:22:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6141fefc >2014-08-24 20:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:22:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5e3dc7cb] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:22:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [57921dee] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:22 PM >2014-08-24 20:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [51d8098c] Autorecovering 1 storage domains >2014-08-24 20:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [51d8098c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [22c83924] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [22c83924] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:25 PM >2014-08-24 20:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [607ee185] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [607ee185] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65827b42 >2014-08-24 20:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [607ee185] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [607ee185] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 65827b42 >2014-08-24 20:27:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [607ee185] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:27:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [607ee185] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [607ee185] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:27:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [22c83924] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:27 PM >2014-08-24 20:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [45510532] Autorecovering 1 storage domains >2014-08-24 20:30:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-75) [45510532] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:30:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [40b03f9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:30:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [40b03f9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:30 PM >2014-08-24 20:30:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:30:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 79e17446 >2014-08-24 20:32:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:32:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 79e17446 >2014-08-24 20:32:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:32:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:32:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [b1ebe0d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:32:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-75) [40b03f9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:32 PM >2014-08-24 20:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [4aa3a5bd] Autorecovering 1 storage domains >2014-08-24 20:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [4aa3a5bd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3cfb7b9d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3cfb7b9d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:35 PM >2014-08-24 20:35:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 161a4088 >2014-08-24 20:37:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:37:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 161a4088 >2014-08-24 20:37:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:37:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:37:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [24ee3dc8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:37:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3cfb7b9d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:37 PM >2014-08-24 20:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [d0bf436] Autorecovering 1 storage domains >2014-08-24 20:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [d0bf436] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [f66b737] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [f66b737] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:40 PM >2014-08-24 20:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6d552aa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6d552aa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74997bb3 >2014-08-24 20:40:22,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Attempting to update VMs/Templates Ovf. >2014-08-24 20:40:22,779 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Attempting to update VM OVFs in Data Center Default >2014-08-24 20:40:22,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Successfully updated VM OVFs in Data Center Default >2014-08-24 20:40:22,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Attempting to update template OVFs in Data Center Default >2014-08-24 20:40:22,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Successfully updated templates OVFs in Data Center Default >2014-08-24 20:40:22,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 20:40:22,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [40784e52] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 20:42:05,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6d552aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:42:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6d552aa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 74997bb3 >2014-08-24 20:42:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6d552aa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:42:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [6d552aa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:42:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6d552aa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:42:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [f66b737] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:42 PM >2014-08-24 20:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [40784e52] Autorecovering 1 storage domains >2014-08-24 20:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [40784e52] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [932ef5e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [932ef5e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:45 PM >2014-08-24 20:45:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [57a61f9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [57a61f9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2bc2e432 >2014-08-24 20:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [57a61f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:47:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [57a61f9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2bc2e432 >2014-08-24 20:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [57a61f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [57a61f9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:47:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [57a61f9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [932ef5e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:47 PM >2014-08-24 20:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [573512e] Autorecovering 1 storage domains >2014-08-24 20:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [573512e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [12255ef8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [12255ef8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:50 PM >2014-08-24 20:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [4c49840d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [4c49840d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ddc0944 >2014-08-24 20:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [4c49840d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:52:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [4c49840d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2ddc0944 >2014-08-24 20:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [4c49840d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [4c49840d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [4c49840d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:52:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [12255ef8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:52 PM >2014-08-24 20:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [1df7d7f0] Autorecovering 1 storage domains >2014-08-24 20:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [1df7d7f0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 20:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [71ded26b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 20:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [71ded26b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 8:55 PM >2014-08-24 20:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 20:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 456d8cab >2014-08-24 20:57:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 20:57:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 456d8cab >2014-08-24 20:57:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 20:57:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 20:57:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [e24eb2a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 20:57:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [71ded26b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 8:57 PM >2014-08-24 21:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [1ceca06b] Autorecovering 1 storage domains >2014-08-24 21:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [1ceca06b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [41fb6292] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [41fb6292] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:00 PM >2014-08-24 21:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3df2a626 >2014-08-24 21:02:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:02:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3df2a626 >2014-08-24 21:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:02:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [3c4653ae] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:02:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [41fb6292] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:02 PM >2014-08-24 21:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [41c58941] Autorecovering 1 storage domains >2014-08-24 21:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [41c58941] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [9ba545a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [9ba545a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:05 PM >2014-08-24 21:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [354b7840] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [354b7840] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f438323 >2014-08-24 21:07:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [354b7840] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:07:05,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [354b7840] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f438323 >2014-08-24 21:07:05,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [354b7840] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:07:05,146 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [354b7840] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:07:05,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [354b7840] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:07:05,150 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [9ba545a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:07 PM >2014-08-24 21:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [195b5629] Autorecovering 1 storage domains >2014-08-24 21:10:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [195b5629] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [b0b08f6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:10:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [b0b08f6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:10 PM >2014-08-24 21:10:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [77355d91] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:10:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [77355d91] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5b3fd1ac >2014-08-24 21:12:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [77355d91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:12:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [77355d91] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5b3fd1ac >2014-08-24 21:12:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [77355d91] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:12:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-32) [77355d91] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:12:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-32) [77355d91] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:12:05,124 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [b0b08f6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:12 PM >2014-08-24 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [3cfb7b9d] Autorecovering 1 storage domains >2014-08-24 21:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [3cfb7b9d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [64164c88] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [64164c88] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:15 PM >2014-08-24 21:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [3e26a875] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [3e26a875] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 258edbcf >2014-08-24 21:17:05,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [3e26a875] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:17:05,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [3e26a875] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 258edbcf >2014-08-24 21:17:05,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [3e26a875] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:17:05,139 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [3e26a875] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:17:05,143 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [3e26a875] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:17:05,144 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [64164c88] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:17 PM >2014-08-24 21:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [46c78fbd] Autorecovering 1 storage domains >2014-08-24 21:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-33) [46c78fbd] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:20 PM >2014-08-24 21:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5a1c2c98 >2014-08-24 21:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5a1c2c98 >2014-08-24 21:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [e3f4e65] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:22 PM >2014-08-24 21:24:56,924 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [3bb19308] Autorecovering 1 storage domains >2014-08-24 21:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-87) [3bb19308] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [718febc7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [718febc7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:25 PM >2014-08-24 21:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [556e57c0] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [556e57c0] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5622c463 >2014-08-24 21:27:05,171 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [556e57c0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:27:05,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [556e57c0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5622c463 >2014-08-24 21:27:05,172 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [556e57c0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:27:05,172 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [556e57c0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:27:05,178 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [556e57c0] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:27:05,178 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-87) [718febc7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:27 PM >2014-08-24 21:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [795b2a8c] Autorecovering 1 storage domains >2014-08-24 21:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [795b2a8c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [3202669b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [3202669b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:30 PM >2014-08-24 21:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [22645cba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [22645cba] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f2cb970 >2014-08-24 21:32:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [22645cba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:32:05,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [22645cba] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6f2cb970 >2014-08-24 21:32:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [22645cba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:32:05,114 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [22645cba] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:32:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [22645cba] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:32:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [3202669b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:32 PM >2014-08-24 21:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [5e26c0d7] Autorecovering 1 storage domains >2014-08-24 21:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [5e26c0d7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [53ba8212] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [53ba8212] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:35 PM >2014-08-24 21:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [6141bb33] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6141bb33] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74c636f1 >2014-08-24 21:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [6141bb33] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:37:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6141bb33] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 74c636f1 >2014-08-24 21:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [6141bb33] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [6141bb33] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [6141bb33] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [53ba8212] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:37 PM >2014-08-24 21:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [55ffbe4] Autorecovering 1 storage domains >2014-08-24 21:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [55ffbe4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [7fc6a713] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [7fc6a713] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:40 PM >2014-08-24 21:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [52771f99] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:40:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [52771f99] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 644cbb4f >2014-08-24 21:40:22,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Attempting to update VMs/Templates Ovf. >2014-08-24 21:40:22,784 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Attempting to update VM OVFs in Data Center Default >2014-08-24 21:40:22,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Successfully updated VM OVFs in Data Center Default >2014-08-24 21:40:22,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Attempting to update template OVFs in Data Center Default >2014-08-24 21:40:22,786 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Successfully updated templates OVFs in Data Center Default >2014-08-24 21:40:22,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 21:40:22,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) [9ba545a] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 21:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [52771f99] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [52771f99] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 644cbb4f >2014-08-24 21:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [52771f99] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [52771f99] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [52771f99] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [7fc6a713] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:42 PM >2014-08-24 21:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [cceb633] Autorecovering 1 storage domains >2014-08-24 21:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [cceb633] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [4d1268a1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [4d1268a1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:45 PM >2014-08-24 21:45:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:45:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 49ddb71c >2014-08-24 21:47:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:47:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 49ddb71c >2014-08-24 21:47:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:47:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-34) [5df4d33c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:47:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [4d1268a1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:47 PM >2014-08-24 21:47:55,940 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 21:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [3ffae007] Autorecovering 1 storage domains >2014-08-24 21:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [3ffae007] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c6d3611] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c6d3611] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:50 PM >2014-08-24 21:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [7f52df89] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [7f52df89] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56eeed96 >2014-08-24 21:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [7f52df89] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:52:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [7f52df89] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 56eeed96 >2014-08-24 21:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [7f52df89] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [7f52df89] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [7f52df89] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:52:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c6d3611] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:52 PM >2014-08-24 21:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [143b6996] Autorecovering 1 storage domains >2014-08-24 21:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [143b6996] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 21:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1dc5abb3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 21:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1dc5abb3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 9:55 PM >2014-08-24 21:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 21:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 408de104 >2014-08-24 21:57:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 21:57:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 408de104 >2014-08-24 21:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 21:57:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 21:57:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [6b6799ef] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 21:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [1dc5abb3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 9:57 PM >2014-08-24 22:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [649afd7d] Autorecovering 1 storage domains >2014-08-24 22:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [649afd7d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44ef2479] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44ef2479] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:00 PM >2014-08-24 22:00:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [16959e1e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:00:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [16959e1e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33c7fee3 >2014-08-24 22:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [16959e1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:02:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [16959e1e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33c7fee3 >2014-08-24 22:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [16959e1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [16959e1e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [16959e1e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [44ef2479] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:02 PM >2014-08-24 22:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Autorecovering 1 storage domains >2014-08-24 22:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [5b05bbe5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5d6313c2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5d6313c2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:05 PM >2014-08-24 22:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [58a665f9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [58a665f9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2904dae0 >2014-08-24 22:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [58a665f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:07:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [58a665f9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2904dae0 >2014-08-24 22:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [58a665f9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [58a665f9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:07:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [58a665f9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:07:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [5d6313c2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:07 PM >2014-08-24 22:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [6c8643e2] Autorecovering 1 storage domains >2014-08-24 22:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [6c8643e2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [24213855] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [24213855] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:10 PM >2014-08-24 22:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5f079081] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:10:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5f079081] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 49758669 >2014-08-24 22:12:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5f079081] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:12:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-48) [5f079081] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 49758669 >2014-08-24 22:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [5f079081] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:12:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-48) [5f079081] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-48) [5f079081] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:12:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [24213855] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:12 PM >2014-08-24 22:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [1808262c] Autorecovering 1 storage domains >2014-08-24 22:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-80) [1808262c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [f704420] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [f704420] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:15 PM >2014-08-24 22:15:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:15:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 175f12ff >2014-08-24 22:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:17:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 175f12ff >2014-08-24 22:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:17:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [62a3b3b8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:17:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-80) [f704420] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:17 PM >2014-08-24 22:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [755d650a] Autorecovering 1 storage domains >2014-08-24 22:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-37) [755d650a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [79a85ab7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [79a85ab7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:20 PM >2014-08-24 22:20:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [7e055b26] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [7e055b26] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 204a3e71 >2014-08-24 22:22:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [7e055b26] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:22:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [7e055b26] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 204a3e71 >2014-08-24 22:22:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [7e055b26] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:22:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [7e055b26] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:22:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [7e055b26] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:22:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-37) [79a85ab7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:22 PM >2014-08-24 22:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [611e9da0] Autorecovering 1 storage domains >2014-08-24 22:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [611e9da0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [7ce5076c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [7ce5076c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:25 PM >2014-08-24 22:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 415e0c8f >2014-08-24 22:27:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:27:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 415e0c8f >2014-08-24 22:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:27:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:27:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-37) [39ca21b6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:27:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [7ce5076c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:27 PM >2014-08-24 22:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [54dca0b4] Autorecovering 1 storage domains >2014-08-24 22:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [54dca0b4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [35fa6c8e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [35fa6c8e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:30 PM >2014-08-24 22:30:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [905fb53] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:30:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [905fb53] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 763a3e4 >2014-08-24 22:32:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [905fb53] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:32:05,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [905fb53] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 763a3e4 >2014-08-24 22:32:05,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [905fb53] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:32:05,113 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [905fb53] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:32:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [905fb53] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:32:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [35fa6c8e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:32 PM >2014-08-24 22:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [53c92f92] Autorecovering 1 storage domains >2014-08-24 22:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [53c92f92] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3382d654] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3382d654] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:35 PM >2014-08-24 22:35:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1f311359 >2014-08-24 22:37:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:37:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1f311359 >2014-08-24 22:37:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:37:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:37:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [2df0ebf4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:37:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3382d654] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:37 PM >2014-08-24 22:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [932ef5e] Autorecovering 1 storage domains >2014-08-24 22:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [932ef5e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [18c5054c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [18c5054c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:40 PM >2014-08-24 22:40:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [4227483f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:40:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4227483f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5fe54940 >2014-08-24 22:40:22,789 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Attempting to update VMs/Templates Ovf. >2014-08-24 22:40:22,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Attempting to update VM OVFs in Data Center Default >2014-08-24 22:40:22,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Successfully updated VM OVFs in Data Center Default >2014-08-24 22:40:22,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Attempting to update template OVFs in Data Center Default >2014-08-24 22:40:22,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Successfully updated templates OVFs in Data Center Default >2014-08-24 22:40:22,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 22:40:22,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) [6df07de7] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 22:42:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [4227483f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:42:05,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4227483f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5fe54940 >2014-08-24 22:42:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [4227483f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:42:05,143 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [4227483f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:42:05,148 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [4227483f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:42:05,148 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [18c5054c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:42 PM >2014-08-24 22:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [72746e09] Autorecovering 1 storage domains >2014-08-24 22:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [72746e09] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [6684055c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [6684055c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:45 PM >2014-08-24 22:45:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [382f4587] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [382f4587] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1b7abf23 >2014-08-24 22:47:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [382f4587] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:47:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [382f4587] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1b7abf23 >2014-08-24 22:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [382f4587] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:47:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [382f4587] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [382f4587] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:47:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [6684055c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:47 PM >2014-08-24 22:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [24213855] Autorecovering 1 storage domains >2014-08-24 22:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [24213855] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [afa607a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [afa607a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:50 PM >2014-08-24 22:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 454d049c >2014-08-24 22:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:52:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 454d049c >2014-08-24 22:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [3526aa1e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [afa607a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:52 PM >2014-08-24 22:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [12255ef8] Autorecovering 1 storage domains >2014-08-24 22:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [12255ef8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 22:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [73ca6825] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 22:55:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [73ca6825] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 10:55 PM >2014-08-24 22:55:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 22:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1a3280ce >2014-08-24 22:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 22:57:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1a3280ce >2014-08-24 22:57:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 22:57:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 22:57:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [15ac5e52] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 22:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [73ca6825] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 10:57 PM >2014-08-24 23:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [64164c88] Autorecovering 1 storage domains >2014-08-24 23:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [64164c88] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [228b9027] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:00:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [228b9027] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:00 PM >2014-08-24 23:00:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [5555451c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [5555451c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21868dea >2014-08-24 23:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [5555451c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:02:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [5555451c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 21868dea >2014-08-24 23:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [5555451c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [5555451c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:02:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [5555451c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:02:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [228b9027] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:02 PM >2014-08-24 23:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [1e50270] Autorecovering 1 storage domains >2014-08-24 23:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-36) [1e50270] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:05 PM >2014-08-24 23:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [569b080b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [569b080b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 71b8f25e >2014-08-24 23:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [569b080b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:07:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [569b080b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 71b8f25e >2014-08-24 23:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [569b080b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [569b080b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:07:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [569b080b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:07 PM >2014-08-24 23:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [1c93c07e] Autorecovering 1 storage domains >2014-08-24 23:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [1c93c07e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1b7875e4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1b7875e4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:10 PM >2014-08-24 23:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7594db42 >2014-08-24 23:12:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:12:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7594db42 >2014-08-24 23:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [50d23bd1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:12:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [1b7875e4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:12 PM >2014-08-24 23:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [3c62d813] Autorecovering 1 storage domains >2014-08-24 23:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [3c62d813] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [796a9339] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [796a9339] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:15 PM >2014-08-24 23:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:15:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: c808753 >2014-08-24 23:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:17:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: c808753 >2014-08-24 23:17:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:17:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [5f3c101e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:17:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [796a9339] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:17 PM >2014-08-24 23:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [2b0b99b0] Autorecovering 1 storage domains >2014-08-24 23:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [2b0b99b0] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3f49f222] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3f49f222] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:20 PM >2014-08-24 23:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [e681002] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [e681002] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 54587002 >2014-08-24 23:20:06,168 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 23:22:05,119 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [e681002] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:22:05,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [e681002] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 54587002 >2014-08-24 23:22:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [e681002] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:22:05,120 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [e681002] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:22:05,125 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [e681002] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:22:05,125 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [3f49f222] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:22 PM >2014-08-24 23:23:23,232 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 23:23:53,546 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-24 23:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [4976802f] Autorecovering 1 storage domains >2014-08-24 23:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [4976802f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [2e1a8ebf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [2e1a8ebf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:25 PM >2014-08-24 23:25:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:25:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5260d567 >2014-08-24 23:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:27:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5260d567 >2014-08-24 23:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:27:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [2c4202a4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:27:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [2e1a8ebf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:27 PM >2014-08-24 23:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [377ceb13] Autorecovering 1 storage domains >2014-08-24 23:30:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [377ceb13] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:30:00,006 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2f990685] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2f990685] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:30 PM >2014-08-24 23:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [62034036] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [62034036] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f1b014b >2014-08-24 23:32:05,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [62034036] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:32:05,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [62034036] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6f1b014b >2014-08-24 23:32:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [62034036] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:32:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [62034036] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:32:05,131 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [62034036] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:32:05,131 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2f990685] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:32 PM >2014-08-24 23:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [73ca6825] Autorecovering 1 storage domains >2014-08-24 23:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [73ca6825] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [62993ea5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [62993ea5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:35 PM >2014-08-24 23:35:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [181575be] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [181575be] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20435dc7 >2014-08-24 23:37:05,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [181575be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:37:05,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [181575be] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 20435dc7 >2014-08-24 23:37:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [181575be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:37:05,129 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [181575be] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:37:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [181575be] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:37:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [62993ea5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:37 PM >2014-08-24 23:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [228b9027] Autorecovering 1 storage domains >2014-08-24 23:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [228b9027] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3f80fdac] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3f80fdac] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:40 PM >2014-08-24 23:40:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:40:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2dc6aaa7 >2014-08-24 23:40:22,796 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Attempting to update VMs/Templates Ovf. >2014-08-24 23:40:22,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Attempting to update VM OVFs in Data Center Default >2014-08-24 23:40:22,799 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Successfully updated VM OVFs in Data Center Default >2014-08-24 23:40:22,799 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Attempting to update template OVFs in Data Center Default >2014-08-24 23:40:22,800 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Successfully updated templates OVFs in Data Center Default >2014-08-24 23:40:22,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-24 23:40:22,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-24 23:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:42:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2dc6aaa7 >2014-08-24 23:42:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:42:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [60a1d10e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:42:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [3f80fdac] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:42 PM >2014-08-24 23:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [1c6d3611] Autorecovering 1 storage domains >2014-08-24 23:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [1c6d3611] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:45:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [25382444] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [25382444] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:45 PM >2014-08-24 23:45:00,024 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [40e22b67] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:45:00,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [40e22b67] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6d2905f6 >2014-08-24 23:47:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [40e22b67] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:47:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [40e22b67] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6d2905f6 >2014-08-24 23:47:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [40e22b67] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:47:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [40e22b67] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:47:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [40e22b67] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:47:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [25382444] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:47 PM >2014-08-24 23:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [4d1268a1] Autorecovering 1 storage domains >2014-08-24 23:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-20) [4d1268a1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [77554cfb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:50:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [77554cfb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:50 PM >2014-08-24 23:50:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [a682849] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [a682849] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5d350443 >2014-08-24 23:52:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [a682849] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:52:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [a682849] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5d350443 >2014-08-24 23:52:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [a682849] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:52:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [a682849] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:52:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [a682849] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:52:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-20) [77554cfb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:52 PM >2014-08-24 23:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [4760417b] Autorecovering 1 storage domains >2014-08-24 23:55:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [4760417b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-24 23:55:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [23ad4fa9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-24 23:55:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [23ad4fa9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/24/14 11:55 PM >2014-08-24 23:55:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-24 23:55:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a5e8290 >2014-08-24 23:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-24 23:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4a5e8290 >2014-08-24 23:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-24 23:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-24 23:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [3a6be97b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-24 23:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [23ad4fa9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/24/14 11:57 PM >2014-08-25 00:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [1825150a] Autorecovering 1 storage domains >2014-08-25 00:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [1825150a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [43b3178c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:00:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [43b3178c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:00 AM >2014-08-25 00:00:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2634874c >2014-08-25 00:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:02:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2634874c >2014-08-25 00:02:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:02:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [5bb641fe] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:02:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [43b3178c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:02 AM >2014-08-25 00:04:18,293 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 00:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [2e1a8ebf] Autorecovering 1 storage domains >2014-08-25 00:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [2e1a8ebf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [54b93050] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [54b93050] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:05 AM >2014-08-25 00:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [4e230296] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4e230296] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 34f77cf8 >2014-08-25 00:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [4e230296] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:07:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [4e230296] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 34f77cf8 >2014-08-25 00:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [4e230296] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:07:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [4e230296] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:07:05,104 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [4e230296] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:07:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [54b93050] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:07 AM >2014-08-25 00:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [549c2557] Autorecovering 1 storage domains >2014-08-25 00:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [549c2557] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [121a3c12] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [121a3c12] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:10 AM >2014-08-25 00:10:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [14270146] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [14270146] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7eda3c0b >2014-08-25 00:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [14270146] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:12:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [14270146] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7eda3c0b >2014-08-25 00:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [14270146] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [14270146] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [14270146] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [121a3c12] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:12 AM >2014-08-25 00:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [38527cf6] Autorecovering 1 storage domains >2014-08-25 00:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-92) [38527cf6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [37c670af] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [37c670af] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:15 AM >2014-08-25 00:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [85dd148] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [85dd148] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37bd5a7 >2014-08-25 00:17:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [85dd148] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:17:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [85dd148] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 37bd5a7 >2014-08-25 00:17:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [85dd148] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:17:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [85dd148] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [85dd148] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:17:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-92) [37c670af] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:17 AM >2014-08-25 00:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [3202669b] Autorecovering 1 storage domains >2014-08-25 00:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [3202669b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [9264f97] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [9264f97] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:20 AM >2014-08-25 00:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2e76a81a >2014-08-25 00:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2e76a81a >2014-08-25 00:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [2a0185a6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:22:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [9264f97] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:22 AM >2014-08-25 00:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [47f88330] Autorecovering 1 storage domains >2014-08-25 00:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [47f88330] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [49480c66] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [49480c66] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:25 AM >2014-08-25 00:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1e38e704] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1e38e704] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5de723de >2014-08-25 00:27:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1e38e704] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:27:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1e38e704] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5de723de >2014-08-25 00:27:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1e38e704] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [1e38e704] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:27:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1e38e704] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:27:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [49480c66] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:27 AM >2014-08-25 00:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [2808001b] Autorecovering 1 storage domains >2014-08-25 00:30:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [2808001b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [66c79fb7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:30:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [66c79fb7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:30 AM >2014-08-25 00:30:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [5f494246] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:30:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [5f494246] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3bbd9f68 >2014-08-25 00:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [5f494246] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [5f494246] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3bbd9f68 >2014-08-25 00:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [5f494246] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [5f494246] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [5f494246] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:32:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [66c79fb7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:32 AM >2014-08-25 00:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [a6e2f58] Autorecovering 1 storage domains >2014-08-25 00:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [a6e2f58] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:35:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [7f368c44] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [7f368c44] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:35 AM >2014-08-25 00:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:35:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 60274892 >2014-08-25 00:37:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:37:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 60274892 >2014-08-25 00:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:37:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [6e1b2969] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [7f368c44] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:37 AM >2014-08-25 00:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [26d93c9f] Autorecovering 1 storage domains >2014-08-25 00:40:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [26d93c9f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [78fae0fa] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:40:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [78fae0fa] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:40 AM >2014-08-25 00:40:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [705e56d6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:40:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [705e56d6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 32ced604 >2014-08-25 00:40:22,803 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update VMs/Templates Ovf. >2014-08-25 00:40:22,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update VM OVFs in Data Center Default >2014-08-25 00:40:22,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully updated VM OVFs in Data Center Default >2014-08-25 00:40:22,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to update template OVFs in Data Center Default >2014-08-25 00:40:22,806 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully updated templates OVFs in Data Center Default >2014-08-25 00:40:22,806 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 00:40:22,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) [1813ff46] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 00:42:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [705e56d6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:42:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [705e56d6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 32ced604 >2014-08-25 00:42:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [705e56d6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:42:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [705e56d6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:42:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [705e56d6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:42:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [78fae0fa] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:42 AM >2014-08-25 00:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [54b93050] Autorecovering 1 storage domains >2014-08-25 00:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [54b93050] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3ce5f56] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3ce5f56] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:45 AM >2014-08-25 00:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [58f7da79] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:45:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [58f7da79] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f98aaf0 >2014-08-25 00:47:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [58f7da79] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:47:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [58f7da79] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7f98aaf0 >2014-08-25 00:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [58f7da79] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:47:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [58f7da79] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:47:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [58f7da79] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:47:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [3ce5f56] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:47 AM >2014-08-25 00:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [44ef2479] Autorecovering 1 storage domains >2014-08-25 00:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-30) [44ef2479] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [245c458f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:50:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [245c458f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:50 AM >2014-08-25 00:50:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [7883f21d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:50:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [7883f21d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 50d595a3 >2014-08-25 00:52:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [7883f21d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:52:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [7883f21d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 50d595a3 >2014-08-25 00:52:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [7883f21d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:52:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-49) [7883f21d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:52:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-49) [7883f21d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:52:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-30) [245c458f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:52 AM >2014-08-25 00:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [1dc5abb3] Autorecovering 1 storage domains >2014-08-25 00:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [1dc5abb3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 00:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5dc26516] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 00:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5dc26516] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 12:55 AM >2014-08-25 00:55:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [1451fc92] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 00:55:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [1451fc92] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 17f412d6 >2014-08-25 00:57:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [1451fc92] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 00:57:05,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [1451fc92] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 17f412d6 >2014-08-25 00:57:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [1451fc92] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 00:57:05,115 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [1451fc92] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 00:57:05,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [1451fc92] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 00:57:05,120 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5dc26516] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 12:57 AM >2014-08-25 00:59:36,669 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 01:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [78116e4e] Autorecovering 1 storage domains >2014-08-25 01:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [78116e4e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78b1cb0f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78b1cb0f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:00 AM >2014-08-25 01:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-21) [60401907] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [60401907] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: c0f2661 >2014-08-25 01:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [60401907] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [60401907] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: c0f2661 >2014-08-25 01:02:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [60401907] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-21) [60401907] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-21) [60401907] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:02:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-66) [78b1cb0f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:02 AM >2014-08-25 01:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [49480c66] Autorecovering 1 storage domains >2014-08-25 01:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-11) [49480c66] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [69f80f1f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [69f80f1f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:05 AM >2014-08-25 01:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [1109ed10] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [1109ed10] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 68a4b64a >2014-08-25 01:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [1109ed10] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:07:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [1109ed10] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 68a4b64a >2014-08-25 01:07:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [1109ed10] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:07:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [1109ed10] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [1109ed10] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:07:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-11) [69f80f1f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:07 AM >2014-08-25 01:09:12,543 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 01:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [5ffc84b1] Autorecovering 1 storage domains >2014-08-25 01:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-52) [5ffc84b1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [137db510] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:10:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [137db510] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:10 AM >2014-08-25 01:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 72387f74 >2014-08-25 01:12:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:12:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 72387f74 >2014-08-25 01:12:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:12:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:12:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [767c6ad9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:12:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-52) [137db510] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:12 AM >2014-08-25 01:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [3b7e7806] Autorecovering 1 storage domains >2014-08-25 01:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [3b7e7806] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [79a58144] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [79a58144] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:15 AM >2014-08-25 01:15:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 59af9530 >2014-08-25 01:17:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:17:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 59af9530 >2014-08-25 01:17:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:17:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:17:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [2c62fc1d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:17:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [79a58144] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:17 AM >2014-08-25 01:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [62993ea5] Autorecovering 1 storage domains >2014-08-25 01:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) [62993ea5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [6650e777] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:20:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [6650e777] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:20 AM >2014-08-25 01:20:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [55c5585e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:20:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [55c5585e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 30123931 >2014-08-25 01:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [55c5585e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:22:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [55c5585e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 30123931 >2014-08-25 01:22:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [55c5585e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:22:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [55c5585e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:22:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [55c5585e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:22:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-79) [6650e777] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:22 AM >2014-08-25 01:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [b0b08f6] Autorecovering 1 storage domains >2014-08-25 01:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-46) [b0b08f6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4341adbf] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4341adbf] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:25 AM >2014-08-25 01:25:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d02942d >2014-08-25 01:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:27:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2d02942d >2014-08-25 01:27:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [5268bdcd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:27:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-46) [4341adbf] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:27 AM >2014-08-25 01:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [25382444] Autorecovering 1 storage domains >2014-08-25 01:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [25382444] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3f9f6e40] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3f9f6e40] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:30 AM >2014-08-25 01:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [430f155b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [430f155b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3c11f478 >2014-08-25 01:31:56,220 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 01:32:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [430f155b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:32:05,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [430f155b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3c11f478 >2014-08-25 01:32:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [430f155b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:32:05,132 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [430f155b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:32:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [430f155b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:32:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [3f9f6e40] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:32 AM >2014-08-25 01:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [5dc26516] Autorecovering 1 storage domains >2014-08-25 01:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [5dc26516] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5fd8fcf4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:35:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5fd8fcf4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:35 AM >2014-08-25 01:35:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [68bce075] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [68bce075] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 768fa41e >2014-08-25 01:35:28,401 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 01:37:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [68bce075] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:37:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-42) [68bce075] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 768fa41e >2014-08-25 01:37:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [68bce075] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:37:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-42) [68bce075] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:37:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-42) [68bce075] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:37:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5fd8fcf4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:37 AM >2014-08-25 01:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [379ab1ed] Autorecovering 1 storage domains >2014-08-25 01:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [379ab1ed] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [1c095948] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:40:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [1c095948] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:40 AM >2014-08-25 01:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [53d8042a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [53d8042a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1f617670 >2014-08-25 01:40:22,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Attempting to update VMs/Templates Ovf. >2014-08-25 01:40:22,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Attempting to update VM OVFs in Data Center Default >2014-08-25 01:40:22,810 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Successfully updated VM OVFs in Data Center Default >2014-08-25 01:40:22,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Attempting to update template OVFs in Data Center Default >2014-08-25 01:40:22,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Successfully updated templates OVFs in Data Center Default >2014-08-25 01:40:22,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 01:40:22,813 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [7320fe81] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 01:42:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [53d8042a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:42:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [53d8042a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1f617670 >2014-08-25 01:42:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [53d8042a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:42:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [53d8042a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:42:05,127 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [53d8042a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:42:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [1c095948] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:42 AM >2014-08-25 01:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [5b82321a] Autorecovering 1 storage domains >2014-08-25 01:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [5b82321a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1094632e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1094632e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:45 AM >2014-08-25 01:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [219c6981] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:45:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [219c6981] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6871f09e >2014-08-25 01:47:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [219c6981] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:47:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [219c6981] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6871f09e >2014-08-25 01:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [219c6981] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:47:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [219c6981] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:47:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [219c6981] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:47:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [1094632e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:47 AM >2014-08-25 01:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [afa607a] Autorecovering 1 storage domains >2014-08-25 01:50:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [afa607a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:50:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:50 AM >2014-08-25 01:50:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [4247b9f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [4247b9f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 16896d52 >2014-08-25 01:50:52,680 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 01:52:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [4247b9f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:52:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [4247b9f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 16896d52 >2014-08-25 01:52:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [4247b9f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:52:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [4247b9f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:52:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [4247b9f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:52:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:52 AM >2014-08-25 01:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [3b117574] Autorecovering 1 storage domains >2014-08-25 01:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [3b117574] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 01:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [55251cf4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 01:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [55251cf4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:55 AM >2014-08-25 01:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 01:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 14a8ac8d >2014-08-25 01:57:05,154 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 01:57:05,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 14a8ac8d >2014-08-25 01:57:05,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 01:57:05,156 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 01:57:05,160 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [7fb9a2b7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 01:57:05,160 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [55251cf4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:57 AM >2014-08-25 02:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [dcf614d] Autorecovering 1 storage domains >2014-08-25 02:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [dcf614d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [1f7f97c8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [1f7f97c8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:00 AM >2014-08-25 02:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [4047a256] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:00:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [4047a256] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6620ef7d >2014-08-25 02:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [4047a256] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:02:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [4047a256] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6620ef7d >2014-08-25 02:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [4047a256] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:02:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [4047a256] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:02:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [4047a256] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:02:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [1f7f97c8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:02 AM >2014-08-25 02:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [22c83924] Autorecovering 1 storage domains >2014-08-25 02:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [22c83924] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:05 AM >2014-08-25 02:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [444855d6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [444855d6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4c6e83db >2014-08-25 02:07:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [444855d6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:07:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [444855d6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4c6e83db >2014-08-25 02:07:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [444855d6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [444855d6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:07:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [444855d6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:07:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:07 AM >2014-08-25 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [4dded307] Autorecovering 1 storage domains >2014-08-25 02:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [4dded307] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [663d8ed4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [663d8ed4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:10 AM >2014-08-25 02:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4d3cd3e >2014-08-25 02:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:12:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4d3cd3e >2014-08-25 02:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [3dae55c2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [663d8ed4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:12 AM >2014-08-25 02:14:21,831 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 02:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [7fdce1b2] Autorecovering 1 storage domains >2014-08-25 02:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [7fdce1b2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [1e260461] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [1e260461] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:15 AM >2014-08-25 02:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [3639eaa] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [3639eaa] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 775a559c >2014-08-25 02:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [3639eaa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:17:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [3639eaa] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 775a559c >2014-08-25 02:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [3639eaa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:17:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [3639eaa] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [3639eaa] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:17:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [1e260461] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:17 AM >2014-08-25 02:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [2f990685] Autorecovering 1 storage domains >2014-08-25 02:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-97) [2f990685] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:20:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:20 AM >2014-08-25 02:20:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 699281c >2014-08-25 02:21:11,105 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 02:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 699281c >2014-08-25 02:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:22:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [6c53d1dd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:22:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:22 AM >2014-08-25 02:23:12,358 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 02:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [39975e0a] Autorecovering 1 storage domains >2014-08-25 02:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [39975e0a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [63b5acb6] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [63b5acb6] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:25 AM >2014-08-25 02:25:00,027 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [3a783301] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:25:00,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [3a783301] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 43d72e71 >2014-08-25 02:27:05,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [3a783301] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:27:05,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [3a783301] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 43d72e71 >2014-08-25 02:27:05,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [3a783301] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:27:05,139 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [3a783301] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:27:05,144 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [3a783301] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:27:05,144 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [63b5acb6] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:27 AM >2014-08-25 02:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [4111c595] Autorecovering 1 storage domains >2014-08-25 02:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-71) [4111c595] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [258c8f2f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [258c8f2f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:30 AM >2014-08-25 02:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [4364fd8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [4364fd8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 213e70ef >2014-08-25 02:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [4364fd8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:32:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [4364fd8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 213e70ef >2014-08-25 02:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [4364fd8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [4364fd8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:32:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [4364fd8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:32:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-71) [258c8f2f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:32 AM >2014-08-25 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [581ad026] Autorecovering 1 storage domains >2014-08-25 02:35:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [581ad026] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [7d813fe1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [7d813fe1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:35 AM >2014-08-25 02:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [340c0b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [340c0b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 940b533 >2014-08-25 02:37:05,142 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [340c0b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:37:05,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [340c0b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 940b533 >2014-08-25 02:37:05,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [340c0b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:37:05,143 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-25) [340c0b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:37:05,147 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [340c0b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:37:05,148 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [7d813fe1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:37 AM >2014-08-25 02:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [6684055c] Autorecovering 1 storage domains >2014-08-25 02:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-49) [6684055c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [564f5285] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [564f5285] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:40 AM >2014-08-25 02:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ace57df >2014-08-25 02:40:22,813 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Attempting to update VMs/Templates Ovf. >2014-08-25 02:40:22,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Attempting to update VM OVFs in Data Center Default >2014-08-25 02:40:22,816 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Successfully updated VM OVFs in Data Center Default >2014-08-25 02:40:22,816 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Attempting to update template OVFs in Data Center Default >2014-08-25 02:40:22,817 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Successfully updated templates OVFs in Data Center Default >2014-08-25 02:40:22,817 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 02:40:22,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) [18c5054c] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 02:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1ace57df >2014-08-25 02:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:42:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [1b37ed36] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:42:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-49) [564f5285] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:42 AM >2014-08-25 02:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [23ad4fa9] Autorecovering 1 storage domains >2014-08-25 02:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [23ad4fa9] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5b16ab89] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5b16ab89] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:45 AM >2014-08-25 02:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 299eb008 >2014-08-25 02:47:05,120 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:47:05,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 299eb008 >2014-08-25 02:47:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:47:05,121 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:47:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [3eeb72a5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:47:05,126 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [5b16ab89] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:47 AM >2014-08-25 02:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [3f80fdac] Autorecovering 1 storage domains >2014-08-25 02:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-58) [3f80fdac] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [7e31f2b7] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [7e31f2b7] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:50 AM >2014-08-25 02:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7d0e47a2 >2014-08-25 02:52:05,144 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:52:05,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7d0e47a2 >2014-08-25 02:52:05,145 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:52:05,145 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:52:05,150 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [61b9b9a7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:52:05,150 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-58) [7e31f2b7] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:52 AM >2014-08-25 02:53:00,325 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 02:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [57921dee] Autorecovering 1 storage domains >2014-08-25 02:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [57921dee] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 02:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [4f4bd1fc] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 02:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [4f4bd1fc] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 2:55 AM >2014-08-25 02:55:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [14ab0049] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 02:55:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [14ab0049] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 39063350 >2014-08-25 02:57:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [14ab0049] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 02:57:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [14ab0049] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 39063350 >2014-08-25 02:57:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [14ab0049] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 02:57:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [14ab0049] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 02:57:05,124 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [14ab0049] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 02:57:05,124 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [4f4bd1fc] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 2:57 AM >2014-08-25 03:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [79a58144] Autorecovering 1 storage domains >2014-08-25 03:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-93) [79a58144] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:00 AM >2014-08-25 03:00:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [58e2e656] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:00:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [58e2e656] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 73b18254 >2014-08-25 03:02:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [58e2e656] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:02:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [58e2e656] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 73b18254 >2014-08-25 03:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [58e2e656] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [58e2e656] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:02:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [58e2e656] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:02:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:02 AM >2014-08-25 03:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [63b5acb6] Autorecovering 1 storage domains >2014-08-25 03:05:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [63b5acb6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [177ee713] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [177ee713] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:05 AM >2014-08-25 03:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [2912e15b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [2912e15b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3efb790b >2014-08-25 03:07:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [2912e15b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:07:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [2912e15b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3efb790b >2014-08-25 03:07:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [2912e15b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [2912e15b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:07:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [2912e15b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:07:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [177ee713] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:07 AM >2014-08-25 03:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [130b3ead] Autorecovering 1 storage domains >2014-08-25 03:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [130b3ead] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [665c4376] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [665c4376] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:10 AM >2014-08-25 03:10:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [2a200644] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [2a200644] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 22332a83 >2014-08-25 03:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [2a200644] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:12:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [2a200644] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 22332a83 >2014-08-25 03:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [2a200644] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:12:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [2a200644] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:12:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [2a200644] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:12:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [665c4376] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:12 AM >2014-08-25 03:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [3f9f6e40] Autorecovering 1 storage domains >2014-08-25 03:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-17) [3f9f6e40] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c3a4b43] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c3a4b43] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:15 AM >2014-08-25 03:15:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4326a390 >2014-08-25 03:17:05,134 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:17:05,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4326a390 >2014-08-25 03:17:05,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:17:05,135 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:17:05,139 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [35f7ab69] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:17:05,139 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-17) [1c3a4b43] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:17 AM >2014-08-25 03:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [4b4909cf] Autorecovering 1 storage domains >2014-08-25 03:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-61) [4b4909cf] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4ff8c14] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4ff8c14] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:20 AM >2014-08-25 03:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [63054555] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [63054555] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1b433afa >2014-08-25 03:22:05,156 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [63054555] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:22:05,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [63054555] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1b433afa >2014-08-25 03:22:05,157 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [63054555] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:22:05,158 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [63054555] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:22:05,162 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [63054555] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:22:05,163 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-61) [4ff8c14] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:22 AM >2014-08-25 03:24:19,308 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 03:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [3f49f222] Autorecovering 1 storage domains >2014-08-25 03:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [3f49f222] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6ccf6053] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:25:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6ccf6053] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:25 AM >2014-08-25 03:25:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33c4e818 >2014-08-25 03:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:27:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 33c4e818 >2014-08-25 03:27:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:27:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:27:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [4cc05d99] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:27:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [6ccf6053] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:27 AM >2014-08-25 03:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [796a9339] Autorecovering 1 storage domains >2014-08-25 03:30:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-68) [796a9339] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [144a5d33] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:30:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [144a5d33] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:30 AM >2014-08-25 03:30:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:30:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 78f6201a >2014-08-25 03:32:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:32:05,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 78f6201a >2014-08-25 03:32:05,131 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:32:05,131 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:32:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-43) [5d9be40a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:32:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-68) [144a5d33] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:32 AM >2014-08-25 03:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [1b7875e4] Autorecovering 1 storage domains >2014-08-25 03:35:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [1b7875e4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:35:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [22ed293a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:35:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [22ed293a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:35 AM >2014-08-25 03:35:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:35:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1e944b84 >2014-08-25 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-22) [7c789607] Start deleteAgedOutAuditLogs >2014-08-25 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-22) [7c789607] Finished deleteAgedOutAuditLogs >2014-08-25 03:37:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:37:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1e944b84 >2014-08-25 03:37:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:37:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [61b06b3b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:37:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [22ed293a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:37 AM >2014-08-25 03:38:42,989 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 03:40:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [2ff93dee] Autorecovering 1 storage domains >2014-08-25 03:40:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [2ff93dee] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:40:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6ba371d8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:40:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6ba371d8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:40 AM >2014-08-25 03:40:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [4d10c1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:40:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [4d10c1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 373687d7 >2014-08-25 03:40:22,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Attempting to update VMs/Templates Ovf. >2014-08-25 03:40:22,820 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Attempting to update VM OVFs in Data Center Default >2014-08-25 03:40:22,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Successfully updated VM OVFs in Data Center Default >2014-08-25 03:40:22,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Attempting to update template OVFs in Data Center Default >2014-08-25 03:40:22,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Successfully updated templates OVFs in Data Center Default >2014-08-25 03:40:22,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 03:40:22,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 03:42:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [4d10c1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:42:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [4d10c1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 373687d7 >2014-08-25 03:42:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [4d10c1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [4d10c1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:42:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [4d10c1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:42:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [6ba371d8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:42 AM >2014-08-25 03:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [7f368c44] Autorecovering 1 storage domains >2014-08-25 03:45:00,019 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [7f368c44] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [70bf46fe] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:45:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [70bf46fe] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:45 AM >2014-08-25 03:45:00,029 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:45:00,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70a066c1 >2014-08-25 03:47:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:47:05,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 70a066c1 >2014-08-25 03:47:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:47:05,115 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:47:05,118 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [6f8f1102] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:47:05,118 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [70bf46fe] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:47 AM >2014-08-25 03:48:33,732 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [18c5054c] Autorecovering 1 storage domains >2014-08-25 03:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [18c5054c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [7fdf45ad] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [7fdf45ad] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:50 AM >2014-08-25 03:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 45cc8e0e >2014-08-25 03:52:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:52:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 45cc8e0e >2014-08-25 03:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:52:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:52:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [7d1b250f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:52:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-60) [7fdf45ad] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:52 AM >2014-08-25 03:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [3ce5f56] Autorecovering 1 storage domains >2014-08-25 03:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-45) [3ce5f56] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [811a5c0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 03:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [811a5c0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 3:55 AM >2014-08-25 03:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [64c2a040] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 03:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [64c2a040] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2d51a898 >2014-08-25 03:57:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [64c2a040] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 03:57:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [64c2a040] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2d51a898 >2014-08-25 03:57:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [64c2a040] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 03:57:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-38) [64c2a040] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 03:57:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [64c2a040] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 03:57:05,103 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-45) [811a5c0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 3:57 AM >2014-08-25 04:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [35fa6c8e] Autorecovering 1 storage domains >2014-08-25 04:00:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-89) [35fa6c8e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [5640cc4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:00:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [5640cc4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:00 AM >2014-08-25 04:00:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:00:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 53dd3cba >2014-08-25 04:02:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:02:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 53dd3cba >2014-08-25 04:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:02:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [4b4b893b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:02:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-89) [5640cc4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:02 AM >2014-08-25 04:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [6ccf6053] Autorecovering 1 storage domains >2014-08-25 04:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [6ccf6053] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [47890880] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [47890880] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:05 AM >2014-08-25 04:05:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [137b24f8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [137b24f8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69cf0aa5 >2014-08-25 04:07:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [137b24f8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:07:05,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [137b24f8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69cf0aa5 >2014-08-25 04:07:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [137b24f8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:07:05,130 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [137b24f8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:07:05,135 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [137b24f8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:07:05,135 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [47890880] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:07 AM >2014-08-25 04:07:14,890 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 04:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [3f8a6a8e] Autorecovering 1 storage domains >2014-08-25 04:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-2) [3f8a6a8e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [7148caa] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [7148caa] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:10 AM >2014-08-25 04:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [54c50b69] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [54c50b69] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 277a7558 >2014-08-25 04:12:05,154 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [54c50b69] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:12:05,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [54c50b69] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 277a7558 >2014-08-25 04:12:05,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [54c50b69] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:12:05,155 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [54c50b69] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:12:05,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [54c50b69] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:12:05,160 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-2) [7148caa] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:12 AM >2014-08-25 04:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [43b3178c] Autorecovering 1 storage domains >2014-08-25 04:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-48) [43b3178c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e386d80] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e386d80] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:15 AM >2014-08-25 04:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [2c773860] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2c773860] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2fe7dc16 >2014-08-25 04:17:05,121 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [2c773860] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:17:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2c773860] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2fe7dc16 >2014-08-25 04:17:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [2c773860] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:17:05,122 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [2c773860] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:17:05,126 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [2c773860] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:17:05,127 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-48) [2e386d80] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:17 AM >2014-08-25 04:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [53ba8212] Autorecovering 1 storage domains >2014-08-25 04:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-12) [53ba8212] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [4661b39f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [4661b39f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:20 AM >2014-08-25 04:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4c2700af >2014-08-25 04:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4c2700af >2014-08-25 04:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2d4e7ee3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:22:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-12) [4661b39f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:22 AM >2014-08-25 04:25:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [5df3f313] Autorecovering 1 storage domains >2014-08-25 04:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-38) [5df3f313] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3e881d7b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:25:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3e881d7b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:25 AM >2014-08-25 04:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:25:00,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3c156bee >2014-08-25 04:27:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:27:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3c156bee >2014-08-25 04:27:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:27:05,100 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:27:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [1c27f5a3] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:27:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-38) [3e881d7b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:27 AM >2014-08-25 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [c2f5adb] Autorecovering 1 storage domains >2014-08-25 04:30:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [c2f5adb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [1c0dc15a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:30:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [1c0dc15a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:30 AM >2014-08-25 04:30:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [681fdb65] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:30:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [681fdb65] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2fd0fa51 >2014-08-25 04:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [681fdb65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:32:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [681fdb65] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2fd0fa51 >2014-08-25 04:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [681fdb65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:32:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [681fdb65] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:32:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [681fdb65] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-34) [1c0dc15a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:32 AM >2014-08-25 04:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [7fc6a713] Autorecovering 1 storage domains >2014-08-25 04:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [7fc6a713] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [74f1c7ad] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [74f1c7ad] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:35 AM >2014-08-25 04:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [1499e95] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [1499e95] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 36f3a6f0 >2014-08-25 04:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [1499e95] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:37:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [1499e95] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 36f3a6f0 >2014-08-25 04:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [1499e95] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [1499e95] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [1499e95] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:37:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [74f1c7ad] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:37 AM >2014-08-25 04:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [7d813fe1] Autorecovering 1 storage domains >2014-08-25 04:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-47) [7d813fe1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [5f6d5098] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [5f6d5098] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:40 AM >2014-08-25 04:40:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:40:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e1501d0 >2014-08-25 04:40:22,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Attempting to update VMs/Templates Ovf. >2014-08-25 04:40:22,825 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Attempting to update VM OVFs in Data Center Default >2014-08-25 04:40:22,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Successfully updated VM OVFs in Data Center Default >2014-08-25 04:40:22,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Attempting to update template OVFs in Data Center Default >2014-08-25 04:40:22,827 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Successfully updated templates OVFs in Data Center Default >2014-08-25 04:40:22,827 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 04:40:22,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) [47890880] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 04:42:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:42:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6e1501d0 >2014-08-25 04:42:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:42:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [65f6ad1e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:42:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-47) [5f6d5098] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:42 AM >2014-08-25 04:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [47890880] Autorecovering 1 storage domains >2014-08-25 04:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-78) [47890880] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [632d11a8] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [632d11a8] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:45 AM >2014-08-25 04:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [3454e79d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [3454e79d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 699d474c >2014-08-25 04:47:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [3454e79d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:47:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [3454e79d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 699d474c >2014-08-25 04:47:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [3454e79d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:47:05,116 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [3454e79d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:47:05,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [3454e79d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:47:05,121 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-78) [632d11a8] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:47 AM >2014-08-25 04:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [4f4bd1fc] Autorecovering 1 storage domains >2014-08-25 04:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) [4f4bd1fc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [574e3432] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [574e3432] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:50 AM >2014-08-25 04:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [31264e0a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [31264e0a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 95637aa >2014-08-25 04:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [31264e0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [31264e0a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 95637aa >2014-08-25 04:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [31264e0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [31264e0a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [31264e0a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-32) [574e3432] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:52 AM >2014-08-25 04:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [78fae0fa] Autorecovering 1 storage domains >2014-08-25 04:55:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [78fae0fa] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 04:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [6b0d814b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 04:55:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [6b0d814b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 4:55 AM >2014-08-25 04:55:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [5dae0169] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 04:55:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5dae0169] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 506099fc >2014-08-25 04:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [5dae0169] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 04:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5dae0169] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 506099fc >2014-08-25 04:57:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [5dae0169] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 04:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [5dae0169] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 04:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [5dae0169] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 04:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [6b0d814b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 4:57 AM >2014-08-25 05:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [378fe4bc] Autorecovering 1 storage domains >2014-08-25 05:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [378fe4bc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:00 AM >2014-08-25 05:00:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f608025 >2014-08-25 05:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:02:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f608025 >2014-08-25 05:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:02:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [1ce63be2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:02:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:02 AM >2014-08-25 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [665c4376] Autorecovering 1 storage domains >2014-08-25 05:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-42) [665c4376] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [56e7863c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [56e7863c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:05 AM >2014-08-25 05:05:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [32108cc9] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:05:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [32108cc9] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 323069f9 >2014-08-25 05:07:05,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [32108cc9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:07:05,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [32108cc9] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 323069f9 >2014-08-25 05:07:05,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [32108cc9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:07:05,131 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [32108cc9] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:07:05,136 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [32108cc9] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:07:05,136 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-42) [56e7863c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:07 AM >2014-08-25 05:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [7c789607] Autorecovering 1 storage domains >2014-08-25 05:10:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-22) [7c789607] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [59cfb2ca] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:10:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [59cfb2ca] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:10 AM >2014-08-25 05:10:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:10:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 32b927f9 >2014-08-25 05:12:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:12:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 32b927f9 >2014-08-25 05:12:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:12:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:12:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [1a2b4873] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:12:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-22) [59cfb2ca] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:12 AM >2014-08-25 05:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [74f1c7ad] Autorecovering 1 storage domains >2014-08-25 05:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [74f1c7ad] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [4ff6e06b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:15:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [4ff6e06b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:15 AM >2014-08-25 05:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6851a8ca >2014-08-25 05:17:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:17:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6851a8ca >2014-08-25 05:17:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:17:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:17:05,112 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [2e1bd752] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:17:05,112 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-67) [4ff6e06b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:17 AM >2014-08-25 05:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [748829b4] Autorecovering 1 storage domains >2014-08-25 05:20:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-16) [748829b4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74ef103e] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74ef103e] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:20 AM >2014-08-25 05:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [35923dff] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [35923dff] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 74ee4436 >2014-08-25 05:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [35923dff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:22:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [35923dff] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 74ee4436 >2014-08-25 05:22:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [35923dff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [35923dff] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:22:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [35923dff] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:22:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-16) [74ef103e] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:22 AM >2014-08-25 05:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [1e260461] Autorecovering 1 storage domains >2014-08-25 05:25:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-59) [1e260461] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3a934e6f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:25:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3a934e6f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:25 AM >2014-08-25 05:25:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [912472c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:25:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [912472c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 69d428 >2014-08-25 05:27:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [912472c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:27:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [912472c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 69d428 >2014-08-25 05:27:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [912472c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:27:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [912472c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [912472c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:27:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-59) [3a934e6f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:27 AM >2014-08-25 05:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [121a3c12] Autorecovering 1 storage domains >2014-08-25 05:30:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [121a3c12] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [2de332da] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [2de332da] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:30 AM >2014-08-25 05:30:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [7526a70d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:30:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [7526a70d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4af22919 >2014-08-25 05:32:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [7526a70d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:32:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [7526a70d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4af22919 >2014-08-25 05:32:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [7526a70d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:32:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [7526a70d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:32:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [7526a70d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:32:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [2de332da] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:32 AM >2014-08-25 05:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [6b0d814b] Autorecovering 1 storage domains >2014-08-25 05:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [6b0d814b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [498a0978] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [498a0978] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:35 AM >2014-08-25 05:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [49db666a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [49db666a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4143061c >2014-08-25 05:37:05,097 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [49db666a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:37:05,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [49db666a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4143061c >2014-08-25 05:37:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [49db666a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:37:05,098 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [49db666a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [49db666a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:37:05,102 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [498a0978] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:37 AM >2014-08-25 05:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [66c79fb7] Autorecovering 1 storage domains >2014-08-25 05:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [66c79fb7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2f0153ac] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2f0153ac] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:40 AM >2014-08-25 05:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [11272121] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [11272121] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5301dced >2014-08-25 05:40:22,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Attempting to update VMs/Templates Ovf. >2014-08-25 05:40:22,830 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Attempting to update VM OVFs in Data Center Default >2014-08-25 05:40:22,831 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Successfully updated VM OVFs in Data Center Default >2014-08-25 05:40:22,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Attempting to update template OVFs in Data Center Default >2014-08-25 05:40:22,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Successfully updated templates OVFs in Data Center Default >2014-08-25 05:40:22,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 05:40:22,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) [6650e777] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 05:42:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [11272121] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:42:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [11272121] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5301dced >2014-08-25 05:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [11272121] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:42:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [11272121] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:42:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [11272121] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:42:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [2f0153ac] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:42 AM >2014-08-25 05:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [1554574b] Autorecovering 1 storage domains >2014-08-25 05:45:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-6) [1554574b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7b6e4076] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:45:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7b6e4076] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:45 AM >2014-08-25 05:45:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:45:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 25cb7da3 >2014-08-25 05:47:05,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:47:05,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 25cb7da3 >2014-08-25 05:47:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:47:05,115 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:47:05,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [6e4299e7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:47:05,120 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-6) [7b6e4076] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:47 AM >2014-08-25 05:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [44a96394] Autorecovering 1 storage domains >2014-08-25 05:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-21) [44a96394] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [75389033] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:50:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [75389033] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:50 AM >2014-08-25 05:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [77018563] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [77018563] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 18798955 >2014-08-25 05:52:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [77018563] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:52:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [77018563] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 18798955 >2014-08-25 05:52:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [77018563] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [77018563] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:52:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [77018563] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:52:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-21) [75389033] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:52 AM >2014-08-25 05:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [5b16ab89] Autorecovering 1 storage domains >2014-08-25 05:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-4) [5b16ab89] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 05:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [37bf6e13] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 05:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [37bf6e13] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 5:55 AM >2014-08-25 05:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 05:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 29caff7a >2014-08-25 05:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 05:57:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 29caff7a >2014-08-25 05:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 05:57:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 05:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [7ba798b5] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 05:57:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-4) [37bf6e13] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 5:57 AM >2014-08-25 05:58:21,855 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 06:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [162febe5] Autorecovering 1 storage domains >2014-08-25 06:00:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-84) [162febe5] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:00:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:00 AM >2014-08-25 06:00:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [c1cb420] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:00:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [c1cb420] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2bea4c4b >2014-08-25 06:02:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [c1cb420] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:02:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [c1cb420] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2bea4c4b >2014-08-25 06:02:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [c1cb420] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:02:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [c1cb420] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:02:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [c1cb420] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:02:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:02 AM >2014-08-25 06:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Autorecovering 1 storage domains >2014-08-25 06:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-29) [71c5f5f3] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [510b7b06] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [510b7b06] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:05 AM >2014-08-25 06:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [1174233f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [1174233f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 66876932 >2014-08-25 06:07:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [1174233f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:07:05,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [1174233f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 66876932 >2014-08-25 06:07:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [1174233f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:07:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [1174233f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:07:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [1174233f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:07:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-29) [510b7b06] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:07 AM >2014-08-25 06:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [55251cf4] Autorecovering 1 storage domains >2014-08-25 06:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-56) [55251cf4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [b2e2602] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [b2e2602] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:10 AM >2014-08-25 06:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5fc510ab >2014-08-25 06:12:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:12:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5fc510ab >2014-08-25 06:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:12:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:12:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [7ed45b8] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-56) [b2e2602] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:12 AM >2014-08-25 06:15:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [1c095948] Autorecovering 1 storage domains >2014-08-25 06:15:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-94) [1c095948] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [f456555] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:15:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [f456555] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:15 AM >2014-08-25 06:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [49a4f708] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [49a4f708] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 62206807 >2014-08-25 06:17:05,134 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [49a4f708] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:17:05,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [49a4f708] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 62206807 >2014-08-25 06:17:05,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [49a4f708] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:17:05,135 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [49a4f708] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:17:05,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [49a4f708] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:17:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-94) [f456555] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:17 AM >2014-08-25 06:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [2f0153ac] Autorecovering 1 storage domains >2014-08-25 06:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-90) [2f0153ac] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [cbf5dce] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:20:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [cbf5dce] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:20 AM >2014-08-25 06:20:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [57ad8739] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:20:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57ad8739] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4667a7e9 >2014-08-25 06:22:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [57ad8739] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:22:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57ad8739] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4667a7e9 >2014-08-25 06:22:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [57ad8739] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:22:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [57ad8739] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:22:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [57ad8739] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:22:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-90) [cbf5dce] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:22 AM >2014-08-25 06:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [663d8ed4] Autorecovering 1 storage domains >2014-08-25 06:25:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [663d8ed4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6ca0350a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:25:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6ca0350a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:25 AM >2014-08-25 06:25:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ac9224a >2014-08-25 06:27:05,107 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:27:05,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1ac9224a >2014-08-25 06:27:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:27:05,108 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:27:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-36) [6e3d5d88] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:27:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-55) [6ca0350a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:27 AM >2014-08-25 06:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [71ded26b] Autorecovering 1 storage domains >2014-08-25 06:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-72) [71ded26b] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [603aa602] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [603aa602] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:30 AM >2014-08-25 06:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [326f7720] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [326f7720] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 32c12c83 >2014-08-25 06:32:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [326f7720] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:32:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [326f7720] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 32c12c83 >2014-08-25 06:32:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [326f7720] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:32:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [326f7720] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [326f7720] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:32:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-72) [603aa602] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:32 AM >2014-08-25 06:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [46a1968d] Autorecovering 1 storage domains >2014-08-25 06:35:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [46a1968d] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [208eb603] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:35:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [208eb603] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:35 AM >2014-08-25 06:35:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:35:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 10e502b6 >2014-08-25 06:37:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:37:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 10e502b6 >2014-08-25 06:37:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:37:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4efc9ac6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:37:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [208eb603] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:37 AM >2014-08-25 06:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [f66b737] Autorecovering 1 storage domains >2014-08-25 06:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [f66b737] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4410065f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:40:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4410065f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:40 AM >2014-08-25 06:40:00,021 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:40:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5cb8ad74 >2014-08-25 06:40:22,834 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Attempting to update VMs/Templates Ovf. >2014-08-25 06:40:22,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Attempting to update VM OVFs in Data Center Default >2014-08-25 06:40:22,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Successfully updated VM OVFs in Data Center Default >2014-08-25 06:40:22,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Attempting to update template OVFs in Data Center Default >2014-08-25 06:40:22,838 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Successfully updated templates OVFs in Data Center Default >2014-08-25 06:40:22,838 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 06:40:22,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) [574e3432] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 06:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:42:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5cb8ad74 >2014-08-25 06:42:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:42:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:42:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [3847ecbc] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [4410065f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:42 AM >2014-08-25 06:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [3382d654] Autorecovering 1 storage domains >2014-08-25 06:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [3382d654] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [2320afff] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [2320afff] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:45 AM >2014-08-25 06:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6124a924 >2014-08-25 06:47:05,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:47:05,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6124a924 >2014-08-25 06:47:05,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:47:05,099 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-14) [2513ca0a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:47:05,104 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [2320afff] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:47 AM >2014-08-25 06:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [1813ff46] Autorecovering 1 storage domains >2014-08-25 06:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-76) [1813ff46] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [48a52088] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [48a52088] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:50 AM >2014-08-25 06:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [345cebd1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:50:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [345cebd1] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 46a8db0d >2014-08-25 06:52:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [345cebd1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:52:05,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-31) [345cebd1] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 46a8db0d >2014-08-25 06:52:05,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [345cebd1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:52:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-31) [345cebd1] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:52:05,117 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-31) [345cebd1] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:52:05,117 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-76) [48a52088] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:52 AM >2014-08-25 06:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [58d0a34e] Autorecovering 1 storage domains >2014-08-25 06:55:00,011 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-5) [58d0a34e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 06:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [371f8ade] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 06:55:00,011 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [371f8ade] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 6:55 AM >2014-08-25 06:55:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [6977c14f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 06:55:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [6977c14f] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5e4f38dc >2014-08-25 06:57:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [6977c14f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 06:57:05,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [6977c14f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5e4f38dc >2014-08-25 06:57:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [6977c14f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 06:57:05,128 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [6977c14f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 06:57:05,133 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [6977c14f] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 06:57:05,133 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-5) [371f8ade] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 6:57 AM >2014-08-25 07:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [41fb6292] Autorecovering 1 storage domains >2014-08-25 07:00:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-26) [41fb6292] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:00:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [450d153] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:00:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [450d153] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:00 AM >2014-08-25 07:00:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [77a76014] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:00:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [77a76014] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c407ad0 >2014-08-25 07:02:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [77a76014] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:02:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [77a76014] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5c407ad0 >2014-08-25 07:02:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [77a76014] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:02:05,112 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-41) [77a76014] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:02:05,116 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [77a76014] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:02:05,116 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-26) [450d153] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:02 AM >2014-08-25 07:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [1094632e] Autorecovering 1 storage domains >2014-08-25 07:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [1094632e] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [53e895cb] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:05:00,014 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [53e895cb] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:05 AM >2014-08-25 07:05:00,023 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7c32d035] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:05:00,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7c32d035] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 14f3da09 >2014-08-25 07:07:05,158 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7c32d035] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:07:05,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7c32d035] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 14f3da09 >2014-08-25 07:07:05,159 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7c32d035] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:07:05,159 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [7c32d035] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:07:05,162 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7c32d035] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:07:05,162 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [53e895cb] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:07 AM >2014-08-25 07:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [7ce5076c] Autorecovering 1 storage domains >2014-08-25 07:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-41) [7ce5076c] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [542945d3] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:10:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [542945d3] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:10 AM >2014-08-25 07:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6f116565] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6f116565] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4dd2120c >2014-08-25 07:12:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6f116565] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:12:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [6f116565] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4dd2120c >2014-08-25 07:12:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [6f116565] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:12:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [6f116565] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:12:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [6f116565] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:12:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-41) [542945d3] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:12 AM >2014-08-25 07:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [9264f97] Autorecovering 1 storage domains >2014-08-25 07:15:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [9264f97] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:15:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [c1e3aa] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:15:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [c1e3aa] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:15 AM >2014-08-25 07:15:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [256d927c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:15:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [256d927c] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6307c664 >2014-08-25 07:17:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [256d927c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:17:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-7) [256d927c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6307c664 >2014-08-25 07:17:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [256d927c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:17:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-7) [256d927c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:17:05,114 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-7) [256d927c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:17:05,114 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [c1e3aa] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:17 AM >2014-08-25 07:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [5d6313c2] Autorecovering 1 storage domains >2014-08-25 07:20:00,014 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-81) [5d6313c2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:20:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [3a3e896a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:20:00,015 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [3a3e896a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:20 AM >2014-08-25 07:20:00,024 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:20:00,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3d5d2c4 >2014-08-25 07:22:05,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:22:05,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3d5d2c4 >2014-08-25 07:22:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:22:05,109 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:22:05,120 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3fc4bda4] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:22:05,120 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-81) [3a3e896a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:22 AM >2014-08-25 07:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [2320afff] Autorecovering 1 storage domains >2014-08-25 07:25:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [2320afff] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:25:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [51d2d8ea] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:25:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [51d2d8ea] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:25 AM >2014-08-25 07:25:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7f0d123c >2014-08-25 07:27:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:27:05,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7f0d123c >2014-08-25 07:27:05,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:27:05,125 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:27:05,129 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-9) [78f2ea7] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:27:05,130 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [51d2d8ea] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:27 AM >2014-08-25 07:27:46,105 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 07:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [177ee713] Autorecovering 1 storage domains >2014-08-25 07:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [177ee713] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1d0ca7b2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:30:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1d0ca7b2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:30 AM >2014-08-25 07:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37dc9480 >2014-08-25 07:32:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:32:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 37dc9480 >2014-08-25 07:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:32:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [7e83d39e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:32:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [1d0ca7b2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:32 AM >2014-08-25 07:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [9ba545a] Autorecovering 1 storage domains >2014-08-25 07:35:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [9ba545a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [72e02f26] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [72e02f26] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:35 AM >2014-08-25 07:35:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [522da35b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:35:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [522da35b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 77262b47 >2014-08-25 07:37:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [522da35b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:37:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [522da35b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 77262b47 >2014-08-25 07:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [522da35b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [522da35b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:37:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [522da35b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:37:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [72e02f26] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:37 AM >2014-08-25 07:40:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [22ed293a] Autorecovering 1 storage domains >2014-08-25 07:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [22ed293a] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [76ed1054] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [76ed1054] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:40 AM >2014-08-25 07:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56258891 >2014-08-25 07:40:22,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Attempting to update VMs/Templates Ovf. >2014-08-25 07:40:22,842 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Attempting to update VM OVFs in Data Center Default >2014-08-25 07:40:22,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Successfully updated VM OVFs in Data Center Default >2014-08-25 07:40:22,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Attempting to update template OVFs in Data Center Default >2014-08-25 07:40:22,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Successfully updated templates OVFs in Data Center Default >2014-08-25 07:40:22,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 07:40:22,845 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) [5c70390e] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 07:42:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:42:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 56258891 >2014-08-25 07:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:42:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:42:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-29) [63cacdc6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:42:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [76ed1054] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:42 AM >2014-08-25 07:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [53e895cb] Autorecovering 1 storage domains >2014-08-25 07:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-19) [53e895cb] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [7c5190b2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [7c5190b2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:45 AM >2014-08-25 07:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [64bf9672] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [64bf9672] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6754cd98 >2014-08-25 07:46:27,255 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 07:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [64bf9672] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:47:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [64bf9672] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 6754cd98 >2014-08-25 07:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [64bf9672] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [64bf9672] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:47:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [64bf9672] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:47:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-19) [7c5190b2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:47 AM >2014-08-25 07:50:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [7320fe81] Autorecovering 1 storage domains >2014-08-25 07:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-44) [7320fe81] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [3606398a] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [3606398a] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:50 AM >2014-08-25 07:50:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [33799b78] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:50:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [33799b78] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4f4853e1 >2014-08-25 07:52:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [33799b78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:52:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [33799b78] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4f4853e1 >2014-08-25 07:52:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [33799b78] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:52:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [33799b78] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:52:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [33799b78] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:52:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-44) [3606398a] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:52 AM >2014-08-25 07:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [6df07de7] Autorecovering 1 storage domains >2014-08-25 07:55:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [6df07de7] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 07:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [93a6a1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 07:55:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [93a6a1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 7:55 AM >2014-08-25 07:55:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [656e2365] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 07:55:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [656e2365] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d9a14ac >2014-08-25 07:57:05,109 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [656e2365] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 07:57:05,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [656e2365] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: d9a14ac >2014-08-25 07:57:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [656e2365] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 07:57:05,110 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [656e2365] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 07:57:05,113 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [656e2365] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 07:57:05,113 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [93a6a1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 7:57 AM >2014-08-25 08:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [2a6514e8] Autorecovering 1 storage domains >2014-08-25 08:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [2a6514e8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [61217ed1] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [61217ed1] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:00 AM >2014-08-25 08:00:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [65df69ba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:00:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [65df69ba] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4ae7e832 >2014-08-25 08:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [65df69ba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:02:05,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-18) [65df69ba] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4ae7e832 >2014-08-25 08:02:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [65df69ba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:02:05,107 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-18) [65df69ba] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:02:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-18) [65df69ba] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:02:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [61217ed1] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:02 AM >2014-08-25 08:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [cc79bb6] Autorecovering 1 storage domains >2014-08-25 08:05:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-86) [cc79bb6] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [11b97347] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:05:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [11b97347] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:05 AM >2014-08-25 08:05:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:05:00,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3d9c9cd4 >2014-08-25 08:07:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:07:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3d9c9cd4 >2014-08-25 08:07:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:07:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:07:05,111 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-12) [110b7f9a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:07:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-86) [11b97347] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:07 AM >2014-08-25 08:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1d0ca7b2] Autorecovering 1 storage domains >2014-08-25 08:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [1d0ca7b2] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [10c54da5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [10c54da5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:10 AM >2014-08-25 08:10:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [203ca651] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:10:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [203ca651] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 245e19ec >2014-08-25 08:12:05,122 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [203ca651] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:12:05,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-50) [203ca651] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 245e19ec >2014-08-25 08:12:05,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-50) [203ca651] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:12:05,124 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-50) [203ca651] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:12:05,128 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-50) [203ca651] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:12:05,128 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-13) [10c54da5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:12 AM >2014-08-25 08:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [72e02f26] Autorecovering 1 storage domains >2014-08-25 08:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-65) [72e02f26] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:15:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [27f10e59] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:15:00,010 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [27f10e59] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:15 AM >2014-08-25 08:15:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:15:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b9143ca >2014-08-25 08:17:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:17:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7b9143ca >2014-08-25 08:17:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:17:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:17:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-40) [7c5bc57b] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:17:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-65) [27f10e59] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:17 AM >2014-08-25 08:17:30,828 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [76ed1054] Autorecovering 1 storage domains >2014-08-25 08:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-39) [76ed1054] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [138d4542] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [138d4542] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:20 AM >2014-08-25 08:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5815e372 >2014-08-25 08:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:22:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 5815e372 >2014-08-25 08:22:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:22:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-2) [2d59b8ec] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:22:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-39) [138d4542] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:22 AM >2014-08-25 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [4170ba40] Autorecovering 1 storage domains >2014-08-25 08:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) [4170ba40] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [24f8127f] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:25:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [24f8127f] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:25 AM >2014-08-25 08:25:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:25:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2678549e >2014-08-25 08:27:05,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:27:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2678549e >2014-08-25 08:27:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:27:05,117 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:27:05,121 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [15d25c5e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:27:05,121 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-28) [24f8127f] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:27 AM >2014-08-25 08:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [61217ed1] Autorecovering 1 storage domains >2014-08-25 08:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-53) [61217ed1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [5d1070c0] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:30:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [5d1070c0] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:30 AM >2014-08-25 08:30:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [500071cd] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [500071cd] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 586fa46c >2014-08-25 08:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [500071cd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:32:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [500071cd] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 586fa46c >2014-08-25 08:32:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [500071cd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:32:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-17) [500071cd] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:32:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-17) [500071cd] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:32:05,111 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-53) [5d1070c0] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:32 AM >2014-08-25 08:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [498a0978] Autorecovering 1 storage domains >2014-08-25 08:35:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-74) [498a0978] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:35:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [7fb32b2b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:35:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [7fb32b2b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:35 AM >2014-08-25 08:35:00,022 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:35:00,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 782b7281 >2014-08-25 08:37:05,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:37:05,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 782b7281 >2014-08-25 08:37:05,117 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:37:05,118 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:37:05,122 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [55c0dbf2] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:37:05,122 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-74) [7fb32b2b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:37 AM >2014-08-25 08:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [73794435] Autorecovering 1 storage domains >2014-08-25 08:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-77) [73794435] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [16adc532] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:40:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [16adc532] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:40 AM >2014-08-25 08:40:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [8e7c030] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:40:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [8e7c030] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3e007bf5 >2014-08-25 08:40:22,845 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Attempting to update VMs/Templates Ovf. >2014-08-25 08:40:22,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Attempting to update VM OVFs in Data Center Default >2014-08-25 08:40:22,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Successfully updated VM OVFs in Data Center Default >2014-08-25 08:40:22,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Attempting to update template OVFs in Data Center Default >2014-08-25 08:40:22,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Successfully updated templates OVFs in Data Center Default >2014-08-25 08:40:22,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 08:40:22,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [653005bc] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 08:42:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [8e7c030] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:42:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-33) [8e7c030] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3e007bf5 >2014-08-25 08:42:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [8e7c030] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:42:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-33) [8e7c030] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:42:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-33) [8e7c030] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:42:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-77) [16adc532] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:42 AM >2014-08-25 08:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [653005bc] Autorecovering 1 storage domains >2014-08-25 08:45:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-43) [653005bc] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [8697709] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:45:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [8697709] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:45 AM >2014-08-25 08:45:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [34e2f58] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:45:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [34e2f58] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 326c482 >2014-08-25 08:47:05,135 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [34e2f58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:47:05,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-3) [34e2f58] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 326c482 >2014-08-25 08:47:05,136 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-3) [34e2f58] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:47:05,136 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-3) [34e2f58] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:47:05,138 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-3) [34e2f58] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:47:05,138 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-43) [8697709] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:47 AM >2014-08-25 08:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [5fd8fcf4] Autorecovering 1 storage domains >2014-08-25 08:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-7) [5fd8fcf4] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5899e5c4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5899e5c4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:50 AM >2014-08-25 08:50:00,019 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [30254e1e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [30254e1e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 232da20a >2014-08-25 08:52:05,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [30254e1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:52:05,110 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [30254e1e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 232da20a >2014-08-25 08:52:05,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [30254e1e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:52:05,111 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-30) [30254e1e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:52:05,115 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-30) [30254e1e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:52:05,115 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-7) [5899e5c4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:52 AM >2014-08-25 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [5d3edabe] Autorecovering 1 storage domains >2014-08-25 08:55:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [5d3edabe] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 08:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [2a0bce3c] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 08:55:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [2a0bce3c] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 8:55 AM >2014-08-25 08:55:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [39b15a45] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 08:55:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [39b15a45] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4d88ca99 >2014-08-25 08:57:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [39b15a45] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 08:57:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [39b15a45] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 4d88ca99 >2014-08-25 08:57:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [39b15a45] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 08:57:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-22) [39b15a45] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 08:57:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-22) [39b15a45] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 08:57:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-31) [2a0bce3c] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 8:57 AM >2014-08-25 09:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [c1e3aa] Autorecovering 1 storage domains >2014-08-25 09:00:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [c1e3aa] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:00:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:00 AM >2014-08-25 09:00:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:00:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 9746e66 >2014-08-25 09:02:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:02:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 9746e66 >2014-08-25 09:02:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:02:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:02:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-39) [1b18c6be] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:02:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:02 AM >2014-08-25 09:03:58,947 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 09:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [18db71fe] Autorecovering 1 storage domains >2014-08-25 09:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [18db71fe] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:05:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [79aaa3a2] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:05:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [79aaa3a2] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:05 AM >2014-08-25 09:05:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:05:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7c48c58c >2014-08-25 09:07:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:07:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 7c48c58c >2014-08-25 09:07:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:07:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:07:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [73c6a7b6] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:07:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-83) [79aaa3a2] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:07 AM >2014-08-25 09:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [6ba371d8] Autorecovering 1 storage domains >2014-08-25 09:10:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-24) [6ba371d8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [5707fcbd] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:10:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [5707fcbd] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:10 AM >2014-08-25 09:10:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [31e6713] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:10:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [31e6713] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 196b4984 >2014-08-25 09:12:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [31e6713] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:12:05,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-6) [31e6713] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 196b4984 >2014-08-25 09:12:05,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [31e6713] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:12:05,106 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-6) [31e6713] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:12:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-6) [31e6713] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:12:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-24) [5707fcbd] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:12 AM >2014-08-25 09:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [70bf46fe] Autorecovering 1 storage domains >2014-08-25 09:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-23) [70bf46fe] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [360cfc68] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:15:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [360cfc68] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:15 AM >2014-08-25 09:15:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [678b672a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:15:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [678b672a] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 59bdaff2 >2014-08-25 09:17:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [678b672a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:17:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [678b672a] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 59bdaff2 >2014-08-25 09:17:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [678b672a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:17:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-45) [678b672a] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:17:05,106 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [678b672a] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:17:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-23) [360cfc68] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:17 AM >2014-08-25 09:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [51d2d8ea] Autorecovering 1 storage domains >2014-08-25 09:20:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-15) [51d2d8ea] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3a645c19] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:20:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3a645c19] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:20 AM >2014-08-25 09:20:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:20:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 51b89ed >2014-08-25 09:22:05,100 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:22:05,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 51b89ed >2014-08-25 09:22:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:22:05,101 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:22:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-24) [7cf6b151] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:22:05,106 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-15) [3a645c19] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:22 AM >2014-08-25 09:23:10,728 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 09:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [64e4d842] Autorecovering 1 storage domains >2014-08-25 09:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-8) [64e4d842] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1ce37aa5] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:25:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1ce37aa5] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:25 AM >2014-08-25 09:25:00,016 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [42f90f43] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [42f90f43] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 67e3f87d >2014-08-25 09:27:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [42f90f43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:27:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [42f90f43] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 67e3f87d >2014-08-25 09:27:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [42f90f43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:27:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-47) [42f90f43] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:27:05,109 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [42f90f43] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:27:05,109 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-8) [1ce37aa5] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:27 AM >2014-08-25 09:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7212c054] Autorecovering 1 storage domains >2014-08-25 09:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-99) [7212c054] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:30:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [1134222b] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:30:00,012 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [1134222b] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:30 AM >2014-08-25 09:30:00,020 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-21) [58d4642e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:30:00,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [58d4642e] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 399173d >2014-08-25 09:32:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [58d4642e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:32:05,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [58d4642e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 399173d >2014-08-25 09:32:05,105 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [58d4642e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:32:05,105 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-21) [58d4642e] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:32:05,110 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-21) [58d4642e] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:32:05,110 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-99) [1134222b] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:32 AM >2014-08-25 09:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [2de332da] Autorecovering 1 storage domains >2014-08-25 09:35:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-57) [2de332da] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:35:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [67b760c4] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:35:00,009 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [67b760c4] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:35 AM >2014-08-25 09:35:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [4279f996] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:35:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [4279f996] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 347b96c3 >2014-08-25 09:37:05,101 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [4279f996] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:37:05,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-11) [4279f996] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 347b96c3 >2014-08-25 09:37:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-11) [4279f996] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:37:05,102 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-11) [4279f996] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:37:05,105 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-11) [4279f996] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:37:05,105 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-57) [67b760c4] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:37 AM >2014-08-25 09:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4410065f] Autorecovering 1 storage domains >2014-08-25 09:40:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [4410065f] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [2260d490] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:40:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [2260d490] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:40 AM >2014-08-25 09:40:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1c6a6dac >2014-08-25 09:40:22,851 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Attempting to update VMs/Templates Ovf. >2014-08-25 09:40:22,852 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Attempting to update VM OVFs in Data Center Default >2014-08-25 09:40:22,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Successfully updated VM OVFs in Data Center Default >2014-08-25 09:40:22,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Attempting to update template OVFs in Data Center Default >2014-08-25 09:40:22,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Successfully updated templates OVFs in Data Center Default >2014-08-25 09:40:22,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 09:40:22,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) [3606398a] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 09:42:05,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:42:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 1c6a6dac >2014-08-25 09:42:05,127 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:42:05,127 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:42:05,132 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-8) [10c78e1d] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:42:05,132 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-98) [2260d490] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:42 AM >2014-08-25 09:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [54ce0936] Autorecovering 1 storage domains >2014-08-25 09:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-82) [54ce0936] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:45:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [789eb238] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:45:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [789eb238] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:45 AM >2014-08-25 09:45:00,017 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [71e486fe] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [71e486fe] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3dd7c377 >2014-08-25 09:47:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [71e486fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:47:05,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-15) [71e486fe] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 3dd7c377 >2014-08-25 09:47:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [71e486fe] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:47:05,103 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-15) [71e486fe] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:47:05,107 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-15) [71e486fe] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:47:05,107 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-82) [789eb238] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:47 AM >2014-08-25 09:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [93a6a1] Autorecovering 1 storage domains >2014-08-25 09:50:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-73) [93a6a1] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 09:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [3d89d729] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 09:50:00,008 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [3d89d729] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 9:50 AM >2014-08-25 09:50:00,018 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 09:50:00,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 629df960 >2014-08-25 09:52:05,103 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host blade to the Storage Domains iso. >2014-08-25 09:52:05,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 629df960 >2014-08-25 09:52:05,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 09:52:05,104 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 09:52:05,108 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-16) [2f8a71ab] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 09:52:05,108 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-73) [3d89d729] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 9:52 AM >2014-08-25 09:53:02,019 INFO [org.ovirt.engine.core.bll.LoginBaseCommand] (ajp-/127.0.0.1:8702-9) Cant login user "pbenas" with authentication profile "internal" because the authentication failed. >2014-08-25 09:53:02,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User pbenas failed to log in. >2014-08-25 09:53:02,027 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-9) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2014-08-25 09:53:07,809 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginAdminUserCommand internal: false. >2014-08-25 09:53:07,814 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-25 09:53:07,844 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-08-25 09:53:07,845 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-6) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-08-25 09:53:08,222 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-1) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-08-25 09:53:38,339 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-7) [55dfe395] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 09:53:38,380 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: d6f7aefd-c3f8-4b68-ace6-b460af7affec Type: VDS >2014-08-25 09:53:38,386 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] START, SetVdsStatusVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 67261233 >2014-08-25 09:53:38,393 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] VDS blade is spm and moved from up calling resetIrs. >2014-08-25 09:53:38,394 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, ignoreStopFailed = false), log id: 332548b1 >2014-08-25 09:53:38,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] START, SpmStopVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 560fe94 >2014-08-25 09:53:38,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] SpmStopVDSCommand::Stopping SPM on vds blade, pool id 00000002-0002-0002-0002-000000000135 >2014-08-25 09:53:38,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] FINISH, SpmStopVDSCommand, log id: 560fe94 >2014-08-25 09:53:38,632 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] FINISH, ResetIrsVDSCommand, log id: 332548b1 >2014-08-25 09:53:38,637 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] FINISH, SetVdsStatusVDSCommand, log id: 67261233 >2014-08-25 09:53:38,683 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 09:53:38,733 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-42) [55dfe395] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: d6f7aefd-c3f8-4b68-ace6-b460af7affec Type: VDS >2014-08-25 09:53:38,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [55dfe395] Correlation ID: 55dfe395, Job ID: 02c9cd35-b4fa-4ca9-bf39-ffdf372c0cea, Call Stack: null, Custom Event ID: -1, Message: Host blade was switched to Maintenance mode by admin. >2014-08-25 09:53:40,636 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-08-25 09:53:40,640 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-08-25 09:53:40,643 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-1) [6a9ede5d] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 608a06d8-ca89-454c-a822-21469c220563 status from InActive to Unknown, reason : no reporting hosts >2014-08-25 09:53:40,647 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-1) [26243347] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 09:53:40,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) [26243347] Correlation ID: 26243347, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-08-25 09:53:41,463 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) [3a3e896a] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = d6f7aefd-c3f8-4b68-ace6-b460af7affec : blade >2014-08-25 09:53:41,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-29) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: blade. >2014-08-25 09:53:41,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-81) [3a3e896a] START, DisconnectStoragePoolVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 31fd2e6 >2014-08-25 09:53:45,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-81) [3a3e896a] FINISH, DisconnectStoragePoolVDSCommand, log id: 31fd2e6 >2014-08-25 09:53:45,017 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-81) [4179d73e] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 09:53:45,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-81) [4179d73e] START, DisconnectStorageServerVDSCommand(HostName = blade, HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2a471246 >2014-08-25 09:53:45,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-81) [4179d73e] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 2a471246 >2014-08-25 09:54:06,451 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-8) [64db2774] Lock Acquired to object EngineLock [exclusiveLocks= key: d6f7aefd-c3f8-4b68-ace6-b460af7affec value: VDS >, sharedLocks= ] >2014-08-25 09:54:06,468 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-2) [64db2774] Running command: RemoveVdsCommand internal: false. Entities affected : ID: d6f7aefd-c3f8-4b68-ace6-b460af7affec Type: VDS >2014-08-25 09:54:06,518 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-2) [64db2774] START, RemoveVdsVDSCommand( HostId = d6f7aefd-c3f8-4b68-ace6-b460af7affec), log id: 5210f779 >2014-08-25 09:54:06,519 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-2) [64db2774] vdsManager::disposing >2014-08-25 09:54:06,519 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-2) [64db2774] FINISH, RemoveVdsVDSCommand, log id: 5210f779 >2014-08-25 09:54:06,533 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [64db2774] Correlation ID: 64db2774, Call Stack: null, Custom Event ID: -1, Message: Host blade was removed by admin. >2014-08-25 09:54:06,533 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-2) [64db2774] Lock freed to object EngineLock [exclusiveLocks= key: d6f7aefd-c3f8-4b68-ace6-b460af7affec value: VDS >, sharedLocks= ] >2014-08-25 10:40:22,857 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) [8697709] Attempting to update VMs/Templates Ovf. >2014-08-25 11:40:22,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) [b9368e7] Attempting to update VMs/Templates Ovf. >2014-08-25 12:40:22,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) [6ca0350a] Attempting to update VMs/Templates Ovf. >2014-08-25 12:47:18,974 INFO [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-6) Registration request: source='10.34.63.137', secured='true', address='10.34.63.137', vdsPort=54321, name='slot-7.rhev.lab.eng.brq.redhat.com', uniqueId='4C4C4544-0052-4C10-8058-B5C04F43354A_84:8f:69:67:1f:0f' >2014-08-25 12:47:19,036 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-6) Running Command: RegisterVds >2014-08-25 12:47:19,379 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-6) [445b9450] Running command: AddVdsCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 12:47:19,418 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [61a12112] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:47:19,433 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-6) [61a12112] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-08-25 12:47:19,436 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] START, RemoveVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 68496746 >2014-08-25 12:47:19,438 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] FINISH, RemoveVdsVDSCommand, log id: 68496746 >2014-08-25 12:47:19,440 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] START, AddVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 5204cf6d >2014-08-25 12:47:19,440 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] AddVds - entered , starting logic to add VDS f2c02bc8-23d6-46c5-94a2-215dba2df5d0 >2014-08-25 12:47:19,441 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] AddVds - VDS f2c02bc8-23d6-46c5-94a2-215dba2df5d0 was added, will try to add it to the resource manager >2014-08-25 12:47:19,442 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [61a12112] Entered VdsManager constructor >2014-08-25 12:47:19,458 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-6) [61a12112] Initialize vdsBroker (10.34.63.137,54,321) >2014-08-25 12:47:19,458 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-6) [61a12112] VDS f2c02bc8-23d6-46c5-94a2-215dba2df5d0 was added to the Resource Manager >2014-08-25 12:47:19,458 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-6) [61a12112] FINISH, AddVdsVDSCommand, log id: 5204cf6d >2014-08-25 12:47:19,464 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [61a12112] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 12:47:19,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [61a12112] Correlation ID: 445b9450, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was added by Non interactive user. >2014-08-25 12:47:19,485 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-6) [61a12112] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: slot-7.rhev.lab.eng.brq.redhat.com, Hostname: 10.34.63.137, UniqueID: 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-08-25 12:47:19,488 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [61a12112] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com registered. >2014-08-25 12:47:42,632 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 12:47:42,633 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 12:47:42,633 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-9) [7cdc11d8] Running command: UpdateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:47:42,719 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 12:47:42,719 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-9) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 12:47:42,727 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [7cdc11d8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 12:47:42,744 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [7cdc11d8] Correlation ID: 7cdc11d8, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-08-25 12:47:42,897 INFO [org.ovirt.engine.core.bll.ApproveVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Running command: ApproveVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:47:42,938 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Before Installation host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 12:47:42,965 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 127ea9e >2014-08-25 12:47:42,969 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] FINISH, SetVdsStatusVDSCommand, log id: 127ea9e >2014-08-25 12:47:43,424 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Installation 10.34.63.137: Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 12:47:43,432 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 12:47:43,475 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Installation of 10.34.63.137. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-08-25 12:47:43,488 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-69) [7024a8d7] Initializing Host: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 12:47:43,533 INFO [org.ovirt.engine.core.utils.archivers.tar.CachedTar] (org.ovirt.thread.pool-4-thread-33) Tarball '/var/cache/ovirt-engine/ovirt-host-deploy.tar' is out of date, re-creating >2014-08-25 12:47:43,964 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-33) SSH execute root@10.34.63.137 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-08-25 12:47:45,006 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Initializing >2014-08-25 12:47:45,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Initializing. >2014-08-25 12:47:45,040 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment setup >2014-08-25 12:47:45,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment setup. >2014-08-25 12:47:45,059 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment packages setup >2014-08-25 12:47:45,065 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment packages setup. >2014-08-25 12:47:45,065 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Programs detection >2014-08-25 12:47:45,070 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Programs detection. >2014-08-25 12:47:45,075 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment customization >2014-08-25 12:47:45,081 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment customization. >2014-08-25 12:47:45,147 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Host is hypervisor >2014-08-25 12:47:45,152 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Host is hypervisor. >2014-08-25 12:47:45,191 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Logs at host located at: '/tmp/ovirt-host-deploy-20140825104743-5wvqzk.log' >2014-08-25 12:47:45,197 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20140825104743-5wvqzk.log'. >2014-08-25 12:47:45,265 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.137 reports unique id 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-08-25 12:47:45,294 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B5C04F43354A to Host 10.34.63.137 >2014-08-25 12:47:45,441 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Setup validation >2014-08-25 12:47:45,446 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Setup validation. >2014-08-25 12:47:45,584 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Hardware supports virtualization >2014-08-25 12:47:45,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Hardware supports virtualization. >2014-08-25 12:47:45,590 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Transaction setup >2014-08-25 12:47:45,595 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction setup. >2014-08-25 12:47:45,595 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Misc configuration >2014-08-25 12:47:45,600 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 12:47:45,601 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Package installation >2014-08-25 12:47:45,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Package installation. >2014-08-25 12:47:46,075 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Misc configuration >2014-08-25 12:47:46,080 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 12:47:46,132 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Setting time >2014-08-25 12:47:46,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Setting time. >2014-08-25 12:47:46,829 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Enrolling certificate >2014-08-25 12:47:46,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Enrolling certificate. >2014-08-25 12:47:52,072 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Transaction commit >2014-08-25 12:47:52,085 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction commit. >2014-08-25 12:47:52,085 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Closing up >2014-08-25 12:47:52,091 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Closing up. >2014-08-25 12:47:59,450 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stopping libvirtd >2014-08-25 12:47:59,456 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stopping libvirtd. >2014-08-25 12:48:00,137 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Starting vdsm >2014-08-25 12:48:00,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Starting vdsm. >2014-08-25 12:48:17,569 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825124817-10.34.63.137-2ef5b563.log' >2014-08-25 12:48:17,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2ef5b563, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825124817-10.34.63.137-2ef5b563.log'. >2014-08-25 12:48:17,907 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:17,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:18,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:18,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:18,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:18,919 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 12:48:19,511 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 12:48:19,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 12:48:20,022 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 12:48:20,023 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 12:48:20,535 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Engine managed to communicate with VDSM agent on host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 12:48:20,877 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5d33550d >2014-08-25 12:48:20,884 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] FINISH, SetVdsStatusVDSCommand, log id: 5d33550d >2014-08-25 12:48:20,884 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] After Installation host slot-7.rhev.lab.eng.brq.redhat.com, oVirtNode >2014-08-25 12:48:20,888 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3435eee2 >2014-08-25 12:48:20,895 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] FINISH, SetVdsStatusVDSCommand, log id: 3435eee2 >2014-08-25 12:48:20,910 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [2ef5b563] Correlation ID: 2ef5b563, Job ID: 8e10e994-bcc2-421f-b1c6-444c65bbf8c1, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was successfully approved by user admin. >2014-08-25 12:48:22,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [144a5d33] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,f2c02bc8-23d6-46c5-94a2-215dba2df5d0]), log id: df94685 >2014-08-25 12:48:22,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [144a5d33] FINISH, GetHardwareInfoVDSCommand, log id: df94685 >2014-08-25 12:48:22,809 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-68) [511be143] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:48:22,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [511be143] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,f2c02bc8-23d6-46c5-94a2-215dba2df5d0]), log id: 3331701c >2014-08-25 12:48:22,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [511be143] FINISH, GetHardwareInfoVDSCommand, log id: 3331701c >2014-08-25 12:48:22,952 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [511be143] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 12:48:22,998 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-68) [768dc034] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 12:48:23,003 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 12:48:23,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 56996b2b >2014-08-25 12:50:33,974 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 12:50:33,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 56996b2b >2014-08-25 12:50:33,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 12:50:33,978 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-68) [1bc351ef] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 12:50:33,978 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 12:50:33,983 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Correlation ID: 1bc351ef, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 12:50:33,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 49e4a5ea >2014-08-25 12:50:35,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) FINISH, ConnectStoragePoolVDSCommand, log id: 49e4a5ea >2014-08-25 12:50:35,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 4e03f163 >2014-08-25 12:50:35,665 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-68) [1bc351ef] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4e03f163 >2014-08-25 12:50:35,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [1bc351ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 12:50:35,679 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-68) [21a47f12] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:50:35,683 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-68) [15708a71] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 12:50:38,898 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus Free, storage pool Default >2014-08-25 12:50:38,903 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] starting spm on vds slot-7.rhev.lab.eng.brq.redhat.com, storage pool Default, prevId -1, LVER 4 >2014-08-25 12:50:38,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] START, SpmStartVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=4, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 62056c9f >2014-08-25 12:50:38,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] spmStart polling started: taskId = bf87469b-35f3-4b1e-8457-30512390d839 >2014-08-25 12:50:58,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] spmStart polling ended: taskId = bf87469b-35f3-4b1e-8457-30512390d839 task status = finished >2014-08-25 12:50:58,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] spmStart polling ended, spm status: SPM >2014-08-25 12:50:58,193 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, taskId=bf87469b-35f3-4b1e-8457-30512390d839), log id: 1fc63e10 >2014-08-25 12:50:58,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] FINISH, HSMClearTaskVDSCommand, log id: 1fc63e10 >2014-08-25 12:50:58,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1151b418, log id: 62056c9f >2014-08-25 12:50:58,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-40) [58a26817] Initialize Irs proxy from vds: 10.34.63.137 >2014-08-25 12:50:58,250 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) [58a26817] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: 10.34.63.137). >2014-08-25 12:50:58,251 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 12:50:58,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [58a26817] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 4951efea >2014-08-25 12:50:58,338 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [58a26817] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 12:50:58,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [58a26817] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 4e6c92d >2014-08-25 12:50:58,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [58a26817] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 4e6c92d >2014-08-25 12:50:58,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-49) [58a26817] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 4951efea >2014-08-25 12:50:58,347 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-49) [58a26817] Discovered no tasks on Storage Pool Default >2014-08-25 12:51:05,980 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 12:56:05,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-16) starting processDomainRecovery for domain 608a06d8-ca89-454c-a822-21469c220563:iso >2014-08-25 12:56:06,033 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-16) Domain 608a06d8-ca89-454c-a822-21469c220563:iso was reported by all hosts in status UP as problematic. Moving the domain to NonOperational. >2014-08-25 12:56:06,052 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-16) [245e7260] Lock Acquired to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 12:56:06,059 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-16) [245e7260] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 12:56:06,068 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-16) [245e7260] Lock freed to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 12:56:06,080 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [245e7260] Correlation ID: 245e7260, Job ID: db57dc27-13bd-41db-82a3-75ae56ca1323, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso (Data Center Default) was deactivated by system because it's not visible by any of the hosts. >2014-08-25 13:00:00,242 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [1f7f97c8] Autorecovering 1 storage domains >2014-08-25 13:00:00,242 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-100) [1f7f97c8] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 13:00:00,243 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [330ab6ec] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 13:00:00,243 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [330ab6ec] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:00 PM >2014-08-25 13:00:00,863 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [de9dba] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 13:00:00,867 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [de9dba] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2cdca8b6 >2014-08-25 13:02:06,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [de9dba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:02:06,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-44) [de9dba] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 2cdca8b6 >2014-08-25 13:02:06,095 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) [de9dba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:02:06,095 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-44) [de9dba] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:02:06,098 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-44) [de9dba] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 13:02:06,098 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-100) [330ab6ec] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:02 PM >2014-08-25 13:03:28,715 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [208eb603] Autorecovering 1 storage domains >2014-08-25 13:05:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-64) [208eb603] Autorecovering storage domains id: 608a06d8-ca89-454c-a822-21469c220563 >2014-08-25 13:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [4f94b794] Running command: ConnectDomainToStorageCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 13:05:00,007 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [4f94b794] ConnectDomainToStorage. Before Connect all hosts to pool. Time:8/25/14 1:05 PM >2014-08-25 13:05:00,013 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [3521d28c] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 13:05:00,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [3521d28c] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 41c99a11 >2014-08-25 13:06:01,325 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-2) [464e2810] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:06:01,355 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:06:01,357 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 4c8152c0 >2014-08-25 13:06:01,357 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] VDS slot-7.rhev.lab.eng.brq.redhat.com is spm and moved from up calling resetIrs. >2014-08-25 13:06:01,357 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, ignoreStopFailed = false), log id: 41ef6323 >2014-08-25 13:06:01,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] START, SpmStopVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 2de8a370 >2014-08-25 13:06:01,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] SpmStopVDSCommand::Stopping SPM on vds slot-7.rhev.lab.eng.brq.redhat.com, pool id 00000002-0002-0002-0002-000000000135 >2014-08-25 13:06:01,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] FINISH, SpmStopVDSCommand, log id: 2de8a370 >2014-08-25 13:06:01,477 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] FINISH, ResetIrsVDSCommand, log id: 41ef6323 >2014-08-25 13:06:01,480 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] FINISH, SetVdsStatusVDSCommand, log id: 4c8152c0 >2014-08-25 13:06:01,521 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:06:01,542 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-38) [464e2810] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:06:01,548 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [464e2810] Correlation ID: 464e2810, Job ID: e4adabaf-6e8b-48b9-a1cb-bc67165b09ae, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-08-25 13:06:03,340 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-47) [5f6d5098] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = f2c02bc8-23d6-46c5-94a2-215dba2df5d0 : slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:06:03,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-41) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:06:03,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-47) [5f6d5098] START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: f2e6640 >2014-08-25 13:06:07,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-47) [5f6d5098] FINISH, DisconnectStoragePoolVDSCommand, log id: f2e6640 >2014-08-25 13:06:07,464 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-47) [14a8553f] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:06:07,478 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-47) [14a8553f] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5ca16ef5 >2014-08-25 13:06:07,759 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-98) [2260d490] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:06:07,763 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-98) [2260d490] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:06:07,765 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-98) [2260d490] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 608a06d8-ca89-454c-a822-21469c220563 status from InActive to Unknown, reason : no reporting hosts >2014-08-25 13:06:07,769 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-98) [472683e8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:06:07,776 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) [472683e8] Correlation ID: 472683e8, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-08-25 13:06:07,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-47) [14a8553f] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 5ca16ef5 >2014-08-25 13:06:24,347 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:06:24,347 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:06:24,348 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-7) [4dc33d9d] Running command: UpdateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:06:24,356 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:06:24,357 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-7) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:06:24,359 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-7) [4dc33d9d] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:06:24,361 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Running command: InstallVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:06:24,365 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Execute upgrade host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:06:24,368 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4d030aa4 >2014-08-25 13:06:24,374 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [4dc33d9d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:06:24,375 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] FINISH, SetVdsStatusVDSCommand, log id: 4d030aa4 >2014-08-25 13:06:24,393 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [4dc33d9d] Correlation ID: 4dc33d9d, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-08-25 13:06:24,631 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Installation 10.34.63.137: Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 13:06:24,639 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Correlation ID: 4dc33d9d, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 13:06:24,693 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Installation 10.34.63.137: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso >2014-08-25 13:06:24,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Correlation ID: 4dc33d9d, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso. >2014-08-25 13:06:24,701 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-6) SSH execute root@10.34.63.137 'mkdir -p '/data/updates'' >2014-08-25 13:07:05,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [3521d28c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:07:05,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-19) [3521d28c] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 41c99a11 >2014-08-25 13:07:05,156 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [3521d28c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:07:05,157 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (org.ovirt.thread.pool-4-thread-19) [3521d28c] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:07:05,159 ERROR [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-19) [3521d28c] Transaction rolled-back for command: org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand. >2014-08-25 13:07:05,159 INFO [org.ovirt.engine.core.bll.storage.ConnectDomainToStorageCommand] (DefaultQuartzScheduler_Worker-64) [4f94b794] ConnectDomainToStorage. After Connect all hosts to pool. Time:8/25/14 1:07 PM >2014-08-25 13:11:24,897 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Timeout during node 10.34.63.137 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.34.63.137' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:] > at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_55] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_55] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] > >2014-08-25 13:11:24,899 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Installation 10.34.63.137: Processing stopped due to timeout >2014-08-25 13:11:24,906 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Correlation ID: 4dc33d9d, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host slot-7.rhev.lab.eng.brq.redhat.com. Processing stopped due to timeout. >2014-08-25 13:11:24,907 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Host installation failed for host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.34.63.137' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:] > at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_55] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_55] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] > >2014-08-25 13:11:24,913 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 37b5de12 >2014-08-25 13:11:24,918 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] FINISH, SetVdsStatusVDSCommand, log id: 37b5de12 >2014-08-25 13:11:24,925 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Correlation ID: 4dc33d9d, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com installation failed. SSH session timeout host 'root@10.34.63.137'. >2014-08-25 13:11:24,925 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-6) [4dc33d9d] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:15:03,982 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-5) [181cdb5b] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:15:04,008 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Running command: ActivateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:15:04,009 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Before acquiring lock in order to prevent monitoring for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:15:04,009 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Lock acquired, from now a monitoring of host will be skipped for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:15:04,018 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7ccb9471 >2014-08-25 13:15:04,022 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] FINISH, SetVdsStatusVDSCommand, log id: 7ccb9471 >2014-08-25 13:15:04,030 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Activate finished. Lock released. Monitoring can run now for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:15:04,047 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Correlation ID: 181cdb5b, Job ID: 52212179-1980-4ba3-869f-291ef9f5b9e4, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was activated by admin. >2014-08-25 13:15:04,052 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-13) [181cdb5b] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:15:05,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-48) [2e386d80] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,f2c02bc8-23d6-46c5-94a2-215dba2df5d0]), log id: 6413a098 >2014-08-25 13:15:05,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-48) [2e386d80] FINISH, GetHardwareInfoVDSCommand, log id: 6413a098 >2014-08-25 13:15:05,447 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-48) [22f1979] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:15:05,456 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) [22f1979] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:15:05,501 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-48) [4948ac2f] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:15:05,508 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:15:05,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 459a6233 >2014-08-25 13:17:15,926 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:17:15,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 459a6233 >2014-08-25 13:17:15,929 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:17:15,930 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-48) [1086e5ad] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:17:15,930 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 13:17:15,935 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Correlation ID: 1086e5ad, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 13:17:15,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-50) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 441784d8 >2014-08-25 13:17:17,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: 441784d8 >2014-08-25 13:17:17,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 4b8a6cad >2014-08-25 13:17:18,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-48) [1086e5ad] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4b8a6cad >2014-08-25 13:17:18,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-48) [1086e5ad] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:17:18,119 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-48) [4fb9b4d0] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:17:18,127 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-48) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:17:18,318 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus Free, storage pool Default >2014-08-25 13:17:18,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] starting spm on vds slot-7.rhev.lab.eng.brq.redhat.com, storage pool Default, prevId -1, LVER 5 >2014-08-25 13:17:18,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] START, SpmStartVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=5, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6fa6a7c9 >2014-08-25 13:17:18,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] spmStart polling started: taskId = 2cd4c7d8-9eb5-4027-9af5-bdddaf2fb706 >2014-08-25 13:17:40,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] spmStart polling ended: taskId = 2cd4c7d8-9eb5-4027-9af5-bdddaf2fb706 task status = finished >2014-08-25 13:17:40,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] spmStart polling ended, spm status: SPM >2014-08-25 13:17:40,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, taskId=2cd4c7d8-9eb5-4027-9af5-bdddaf2fb706), log id: 5199ae8a >2014-08-25 13:17:40,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] FINISH, HSMClearTaskVDSCommand, log id: 5199ae8a >2014-08-25 13:17:40,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7b29e9f, log id: 6fa6a7c9 >2014-08-25 13:17:40,733 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] Initialize Irs proxy from vds: 10.34.63.137 >2014-08-25 13:17:40,739 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: 10.34.63.137). >2014-08-25 13:17:40,740 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:17:40,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 6a8d1ba6 >2014-08-25 13:17:40,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 13:17:40,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 6c8dd233 >2014-08-25 13:17:40,864 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 6c8dd233 >2014-08-25 13:17:40,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6a8d1ba6 >2014-08-25 13:17:40,864 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-39) [4bdee3c7] Discovered no tasks on Storage Pool Default >2014-08-25 13:22:18,129 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-24) starting processDomainRecovery for domain 608a06d8-ca89-454c-a822-21469c220563:iso >2014-08-25 13:22:18,180 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-24) Domain 608a06d8-ca89-454c-a822-21469c220563:iso was reported by all hosts in status UP as problematic. Moving the domain to NonOperational. >2014-08-25 13:22:18,199 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-24) [7ef8026e] Lock Acquired to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 13:22:18,208 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-24) [7ef8026e] Running command: DeactivateStorageDomainCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 13:22:18,215 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-24) [7ef8026e] Lock freed to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 13:22:18,225 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [7ef8026e] Correlation ID: 7ef8026e, Job ID: 7f200589-f42e-4eda-b230-c50a09e068c8, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso (Data Center Default) was deactivated by system because it's not visible by any of the hosts. >2014-08-25 13:23:48,022 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-5) [60752724] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:23:48,028 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:23:48,030 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 387f705e >2014-08-25 13:23:48,030 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] VDS slot-7.rhev.lab.eng.brq.redhat.com is spm and moved from up calling resetIrs. >2014-08-25 13:23:48,031 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, ignoreStopFailed = false), log id: 168c7fea >2014-08-25 13:23:48,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] START, SpmStopVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 1296a0e5 >2014-08-25 13:23:48,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] SpmStopVDSCommand::Stopping SPM on vds slot-7.rhev.lab.eng.brq.redhat.com, pool id 00000002-0002-0002-0002-000000000135 >2014-08-25 13:23:48,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] FINISH, SpmStopVDSCommand, log id: 1296a0e5 >2014-08-25 13:23:48,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] FINISH, ResetIrsVDSCommand, log id: 168c7fea >2014-08-25 13:23:48,197 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] FINISH, SetVdsStatusVDSCommand, log id: 387f705e >2014-08-25 13:23:48,237 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:23:48,259 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-19) [60752724] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:23:48,265 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-19) [60752724] Correlation ID: 60752724, Job ID: 7cd7f96e-f2d8-4b2d-9348-d41351345d4b, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-08-25 13:23:49,014 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-42) [56e7863c] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = f2c02bc8-23d6-46c5-94a2-215dba2df5d0 : slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:23:49,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-21) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:23:49,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-42) [56e7863c] START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 58927e81 >2014-08-25 13:23:52,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-42) [56e7863c] FINISH, DisconnectStoragePoolVDSCommand, log id: 58927e81 >2014-08-25 13:23:52,954 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-42) [5e3ad0a5] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:23:52,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [5e3ad0a5] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 494ee5bc >2014-08-25 13:23:53,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-42) [5e3ad0a5] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 494ee5bc >2014-08-25 13:23:54,118 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-51) [537a6a15] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:23:54,121 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-51) [537a6a15] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:23:54,129 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-51) [537a6a15] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 608a06d8-ca89-454c-a822-21469c220563 status from InActive to Unknown, reason : no reporting hosts >2014-08-25 13:23:54,133 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-51) [38962e90] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:23:54,139 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) [38962e90] Correlation ID: 38962e90, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-08-25 13:23:55,453 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:23:55,453 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:23:55,453 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-8) [80438d0] Running command: UpdateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:23:55,466 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:23:55,466 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-8) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:23:55,466 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-8) [80438d0] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:23:55,469 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] Running command: InstallVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:23:55,469 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] Execute upgrade host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:23:55,471 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7de38260 >2014-08-25 13:23:55,475 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [80438d0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:23:55,476 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] FINISH, SetVdsStatusVDSCommand, log id: 7de38260 >2014-08-25 13:23:55,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [80438d0] Correlation ID: 80438d0, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-08-25 13:23:55,759 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-32) [80438d0] Installation 10.34.63.137: Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 13:23:55,767 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [80438d0] Correlation ID: 80438d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 13:23:55,805 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-32) [80438d0] Installation 10.34.63.137: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso >2014-08-25 13:23:55,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [80438d0] Correlation ID: 80438d0, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso. >2014-08-25 13:23:55,811 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-32) SSH execute root@10.34.63.137 'mkdir -p '/data/updates'' >2014-08-25 13:28:56,006 ERROR [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (org.ovirt.thread.pool-4-thread-32) [80438d0] Timeout during node 10.34.63.137 upgrade: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.34.63.137' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:] > at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_55] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_55] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] > >2014-08-25 13:28:56,008 ERROR [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-32) [80438d0] Installation 10.34.63.137: Processing stopped due to timeout >2014-08-25 13:28:56,019 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [80438d0] Correlation ID: 80438d0, Call Stack: null, Custom Event ID: -1, Message: Failed to install Host slot-7.rhev.lab.eng.brq.redhat.com. Processing stopped due to timeout. >2014-08-25 13:28:56,020 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] Host installation failed for host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com.: javax.naming.TimeLimitExceededException: SSH session timeout host 'root@10.34.63.137' > at org.ovirt.engine.core.utils.ssh.SSHClient.executeCommand(SSHClient.java:499) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHClient.sendFile(SSHClient.java:633) [utils.jar:] > at org.ovirt.engine.core.utils.ssh.SSHDialog.sendFile(SSHDialog.java:374) [utils.jar:] > at org.ovirt.engine.core.bll.OVirtNodeUpgrade.execute(OVirtNodeUpgrade.java:200) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.upgradeNode(InstallVdsCommand.java:287) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:154) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:189) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:156) [bll.jar:] > at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:165) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_55] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_55] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] > >2014-08-25 13:28:56,036 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=InstallFailed, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4c2ba352 >2014-08-25 13:28:56,040 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] FINISH, SetVdsStatusVDSCommand, log id: 4c2ba352 >2014-08-25 13:28:56,050 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [80438d0] Correlation ID: 80438d0, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com installation failed. SSH session timeout host 'root@10.34.63.137'. >2014-08-25 13:28:56,051 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-32) [80438d0] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:30:39,531 WARN [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-8) [43272580] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL >2014-08-25 13:30:45,596 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [4fafe311] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:30:45,622 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Running command: ActivateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:30:45,622 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Before acquiring lock in order to prevent monitoring for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:30:45,622 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Lock acquired, from now a monitoring of host will be skipped for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:30:45,630 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2ff469ee >2014-08-25 13:30:45,634 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] FINISH, SetVdsStatusVDSCommand, log id: 2ff469ee >2014-08-25 13:30:45,663 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Activate finished. Lock released. Monitoring can run now for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:30:45,670 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Correlation ID: 4fafe311, Job ID: b2d08fdd-10fc-49ac-99f1-b2d706530947, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was activated by admin. >2014-08-25 13:30:45,675 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-39) [4fafe311] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:30:48,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [5d1070c0] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,f2c02bc8-23d6-46c5-94a2-215dba2df5d0]), log id: 4eee6a27 >2014-08-25 13:30:48,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [5d1070c0] FINISH, GetHardwareInfoVDSCommand, log id: 4eee6a27 >2014-08-25 13:30:48,094 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-53) [6d7ebd65] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:30:48,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [6d7ebd65] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:30:48,116 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-53) [50f549fe] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:30:48,121 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:30:48,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: cc2095 >2014-08-25 13:32:58,590 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [7353012f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:32:58,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: cc2095 >2014-08-25 13:32:58,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [7353012f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:32:58,593 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-53) [7353012f] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:32:58,593 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 13:32:58,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [7353012f] Correlation ID: 7353012f, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 13:32:58,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-27) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 1987e269 >2014-08-25 13:32:59,524 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-27) FINISH, ConnectStoragePoolVDSCommand, log id: 1987e269 >2014-08-25 13:32:59,551 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 3ba90b52 >2014-08-25 13:32:59,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [7353012f] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3ba90b52 >2014-08-25 13:32:59,717 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [7353012f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:32:59,726 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:32:59,732 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-11) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:33:03,999 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-5) [7845301] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:33:04,001 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-5) [7845301] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 2ddc1768 >2014-08-25 13:33:04,005 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-5) [7845301] FINISH, SetVdsStatusVDSCommand, log id: 2ddc1768 >2014-08-25 13:33:04,123 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-5) [7845301] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:33:04,128 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [7845301] Correlation ID: 7845301, Job ID: 22490b0a-b580-4ef2-ab7f-b17eb3fea03f, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-08-25 13:33:05,818 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-41) [542945d3] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = f2c02bc8-23d6-46c5-94a2-215dba2df5d0 : slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:33:05,857 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-4) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:33:05,858 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-4) Domain 608a06d8-ca89-454c-a822-21469c220563:iso has recovered from problem. No active host in the DC is reporting it as poblematic, so clearing the domain recovery timer. >2014-08-25 13:33:05,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-41) [542945d3] START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 6b78ed85 >2014-08-25 13:33:10,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-41) [542945d3] FINISH, DisconnectStoragePoolVDSCommand, log id: 6b78ed85 >2014-08-25 13:33:10,440 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-41) [92a152] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:33:10,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-41) [92a152] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44c7a84b >2014-08-25 13:33:10,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-41) [92a152] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 44c7a84b >2014-08-25 13:33:20,688 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:33:20,689 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:33:20,689 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-4) [7657e6c2] Running command: UpdateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:33:20,715 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:33:20,716 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:33:20,717 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (ajp-/127.0.0.1:8702-4) [7657e6c2] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:33:20,723 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Running command: InstallVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:33:20,723 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Execute upgrade host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:33:20,725 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 33883643 >2014-08-25 13:33:20,730 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] FINISH, SetVdsStatusVDSCommand, log id: 33883643 >2014-08-25 13:33:20,738 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [7657e6c2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:33:20,764 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [7657e6c2] Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-08-25 13:33:21,003 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Installation 10.34.63.137: Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 13:33:21,010 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 13:33:21,051 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Installation 10.34.63.137: Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso >2014-08-25 13:33:21,058 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Sending file /usr/share/rhev-hypervisor/rhevh-6.5-20140821.1.el6ev.iso to /data/updates/ovirt-node-image.iso. >2014-08-25 13:33:21,058 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-14) SSH execute root@10.34.63.137 'mkdir -p '/data/updates'' >2014-08-25 13:33:44,344 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Installation 10.34.63.137: Executing /usr/share/vdsm-reg/vdsm-upgrade >2014-08-25 13:33:44,350 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Executing /usr/share/vdsm-reg/vdsm-upgrade. >2014-08-25 13:33:44,351 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-14) SSH execute root@10.34.63.137 '/usr/share/vdsm-reg/vdsm-upgrade' >2014-08-25 13:34:20,295 INFO [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.34.63.137: <BSTRAP component='RHEL_INSTALL' status='OK' message='vdsm daemon stopped for upgrade process!'/> >2014-08-25 13:34:20,308 INFO [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.34.63.137: Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! >2014-08-25 13:34:20,314 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Step: RHEL_INSTALL; Details: vdsm daemon stopped for upgrade process! . >2014-08-25 13:34:20,314 INFO [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.34.63.137: <BSTRAP component='setMountPoint' status='OK' message='Mount succeeded.'/> >2014-08-25 13:34:20,318 INFO [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.34.63.137: Step: setMountPoint; Details: Mount succeeded. >2014-08-25 13:34:20,333 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Step: setMountPoint; Details: Mount succeeded. . >2014-08-25 13:34:20,334 INFO [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.34.63.137: <BSTRAP component='doUpgrade' status='OK' message='Upgrade Succeeded. Rebooting'/> >2014-08-25 13:34:20,334 INFO [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.34.63.137: Step: doUpgrade; Details: Upgrade Succeeded. Rebooting >2014-08-25 13:34:20,339 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Step: doUpgrade; Details: Upgrade Succeeded. Rebooting . >2014-08-25 13:34:20,340 INFO [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.34.63.137: <BSTRAP component='umount' status='OK' message='umount Succeeded'/> >2014-08-25 13:34:20,340 INFO [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.34.63.137: Step: umount; Details: umount Succeeded >2014-08-25 13:34:20,346 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Step: umount; Details: umount Succeeded . >2014-08-25 13:34:20,346 INFO [org.ovirt.engine.core.bll.OVirtNodeUpgrade] (OVirtNodeUpgrade) update from host 10.34.63.137: <BSTRAP component='RHEV_INSTALL' status='OK'/> >2014-08-25 13:34:20,346 INFO [org.ovirt.engine.core.bll.InstallerMessages] (OVirtNodeUpgrade) Installation 10.34.63.137: Step: RHEV_INSTALL >2014-08-25 13:34:20,352 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (OVirtNodeUpgrade) Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Step: RHEV_INSTALL. >2014-08-25 13:34:20,354 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Reboot, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 61cd08ab >2014-08-25 13:34:20,358 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] FINISH, SetVdsStatusVDSCommand, log id: 61cd08ab >2014-08-25 13:34:20,359 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] After upgrade host f2c02bc8-23d6-46c5-94a2-215dba2df5d0, slot-7.rhev.lab.eng.brq.redhat.com: success >2014-08-25 13:34:20,359 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-44) [7657e6c2] Waiting 300 seconds, for server to finish reboot process. >2014-08-25 13:34:20,365 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Correlation ID: 7657e6c2, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com installed >2014-08-25 13:34:20,366 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-14) [7657e6c2] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:39:20,363 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) [7657e6c2] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Maintenance, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 77cdec24 >2014-08-25 13:39:20,367 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) [7657e6c2] FINISH, SetVdsStatusVDSCommand, log id: 77cdec24 >2014-08-25 13:40:06,088 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-6) [4510e265] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:40:06,105 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] Running command: ActivateVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:40:06,105 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] Before acquiring lock in order to prevent monitoring for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:40:06,105 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] Lock acquired, from now a monitoring of host will be skipped for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:40:06,117 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4e5b8aeb >2014-08-25 13:40:06,120 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] FINISH, SetVdsStatusVDSCommand, log id: 4e5b8aeb >2014-08-25 13:40:06,137 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] Activate finished. Lock released. Monitoring can run now for host slot-7.rhev.lab.eng.brq.redhat.com from data-center Default >2014-08-25 13:40:06,141 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4510e265] Correlation ID: 4510e265, Job ID: 553d6bcc-a900-4614-895a-9665bb15fff9, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was activated by admin. >2014-08-25 13:40:06,146 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-35) [4510e265] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:40:08,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-11) [69f80f1f] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,f2c02bc8-23d6-46c5-94a2-215dba2df5d0]), log id: 3d809c82 >2014-08-25 13:40:08,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-11) [69f80f1f] FINISH, GetHardwareInfoVDSCommand, log id: 3d809c82 >2014-08-25 13:40:08,621 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-11) [f783547] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:40:08,629 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [f783547] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:40:08,637 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-11) [2be63a02] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:40:08,642 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:40:08,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 373b733e >2014-08-25 13:40:22,862 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) [603aa602] Attempting to update VMs/Templates Ovf. >2014-08-25 13:42:19,481 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:42:19,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 373b733e >2014-08-25 13:42:19,485 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:42:19,486 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-11) [d77c4fc] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:42:19,486 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 13:42:19,491 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Correlation ID: d77c4fc, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 13:42:19,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-38) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 51df9b34 >2014-08-25 13:42:21,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-38) FINISH, ConnectStoragePoolVDSCommand, log id: 51df9b34 >2014-08-25 13:42:21,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 5cf1bdba >2014-08-25 13:42:22,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-11) [d77c4fc] FINISH, SetMOMPolicyParametersVDSCommand, log id: 5cf1bdba >2014-08-25 13:42:22,076 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [d77c4fc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:42:22,089 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-11) [30533713] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:42:22,096 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-40) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:42:25,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus Free, storage pool Default >2014-08-25 13:42:25,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] starting spm on vds slot-7.rhev.lab.eng.brq.redhat.com, storage pool Default, prevId -1, LVER 6 >2014-08-25 13:42:25,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] START, SpmStartVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=6, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 672651b5 >2014-08-25 13:42:25,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] spmStart polling started: taskId = 8888fb09-1e0d-4b04-8a30-6f9d1625f492 >2014-08-25 13:43:55,787 WARN [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-3) [8712572] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_SPM_CONTENDING >2014-08-25 13:45:03,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] spmStart polling ended: taskId = 8888fb09-1e0d-4b04-8a30-6f9d1625f492 task status = finished >2014-08-25 13:45:03,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] spmStart polling ended, spm status: SPM >2014-08-25 13:45:03,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, taskId=8888fb09-1e0d-4b04-8a30-6f9d1625f492), log id: 6f3c11c5 >2014-08-25 13:45:03,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] FINISH, HSMClearTaskVDSCommand, log id: 6f3c11c5 >2014-08-25 13:45:03,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@17ab4b02, log id: 672651b5 >2014-08-25 13:45:03,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-62) [5c70390e] Initialize Irs proxy from vds: 10.34.63.137 >2014-08-25 13:45:03,908 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-62) [5c70390e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: 10.34.63.137). >2014-08-25 13:45:03,908 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:45:04,015 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-4) [5c70390e] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 2a9690bd >2014-08-25 13:45:04,110 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-4) [5c70390e] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 13:45:04,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-4) [5c70390e] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: 26728a73 >2014-08-25 13:45:04,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-4) [5c70390e] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 26728a73 >2014-08-25 13:45:04,120 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-4) [5c70390e] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 2a9690bd >2014-08-25 13:45:04,120 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-4) [5c70390e] Discovered no tasks on Storage Pool Default >2014-08-25 13:45:21,379 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 6734cb69 >2014-08-25 13:45:21,779 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] Failed in GetFileStatsVDS method >2014-08-25 13:45:21,779 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] IrsBroker::Failed::GetFileStatsVDS due to: IRSErrorException: IRSGenericException: IRSErrorException: Failed to GetFileStatsVDS, error = Storage domain does not exist: ('608a06d8-ca89-454c-a822-21469c220563',), code = 358 >2014-08-25 13:45:21,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] FINISH, GetFileStatsVDSCommand, log id: 6734cb69 >2014-08-25 13:45:21,782 WARN [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] The refresh process from VDSM, for Iso files failed. >2014-08-25 13:45:21,783 ERROR [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to GetFileStatsVDS, error = Storage domain does not exist: ('608a06d8-ca89-454c-a822-21469c220563',), code = 358 (Failed with error StorageDomainDoesNotExist and code 358) >2014-08-25 13:45:21,784 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (org.ovirt.thread.pool-4-thread-42) [1c3a4b43] Finished automatic refresh process for ISO file type with failure, for storage domain id 608a06d8-ca89-454c-a822-21469c220563. >2014-08-25 13:45:21,832 ERROR [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (DefaultQuartzScheduler_Worker-17) [1c3a4b43] The following storage domains had a problem retrieving data from VDSM ( Storage Pool Id: 00000002-0002-0002-0002-000000000135 Storage domain Id: 608a06d8-ca89-454c-a822-21469c220563 File type: ISO) >2014-08-25 13:45:21,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) [1c3a4b43] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list failed for domain(s): iso (ISO file type). Please check domain activity. >2014-08-25 13:46:56,858 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-6) [3cf57483] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:46:56,889 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:46:56,891 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 77ef74ce >2014-08-25 13:46:56,891 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] VDS slot-7.rhev.lab.eng.brq.redhat.com is spm and moved from up calling resetIrs. >2014-08-25 13:46:56,891 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, ignoreStopFailed = false), log id: 5f6af6ba >2014-08-25 13:46:56,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] START, SpmStopVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 6c62a0a2 >2014-08-25 13:46:56,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] SpmStopVDSCommand::Stopping SPM on vds slot-7.rhev.lab.eng.brq.redhat.com, pool id 00000002-0002-0002-0002-000000000135 >2014-08-25 13:46:57,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] FINISH, SpmStopVDSCommand, log id: 6c62a0a2 >2014-08-25 13:46:57,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] FINISH, ResetIrsVDSCommand, log id: 5f6af6ba >2014-08-25 13:46:57,042 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] FINISH, SetVdsStatusVDSCommand, log id: 77ef74ce >2014-08-25 13:46:57,085 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:46:57,107 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-6) [3cf57483] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:46:57,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [3cf57483] Correlation ID: 3cf57483, Job ID: c80b8604-7f37-4d5a-a2ff-f01533243741, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-08-25 13:46:58,519 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-10) [1b437dc7] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = f2c02bc8-23d6-46c5-94a2-215dba2df5d0 : slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:46:58,530 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-29) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:46:58,531 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-29) Domain 608a06d8-ca89-454c-a822-21469c220563:iso has recovered from problem. No active host in the DC is reporting it as poblematic, so clearing the domain recovery timer. >2014-08-25 13:46:58,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-10) [1b437dc7] START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 6ab90c63 >2014-08-25 13:47:02,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-10) [1b437dc7] FINISH, DisconnectStoragePoolVDSCommand, log id: 6ab90c63 >2014-08-25 13:47:02,213 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-10) [4a00aa00] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:47:02,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-10) [4a00aa00] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4dd01 >2014-08-25 13:47:02,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-10) [4a00aa00] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 4dd01 >2014-08-25 13:47:05,392 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-7) [2c9b8481] Lock Acquired to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:47:05,400 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] Running command: RemoveVdsCommand internal: false. Entities affected : ID: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 Type: VDS >2014-08-25 13:47:05,444 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] START, RemoveVdsVDSCommand( HostId = f2c02bc8-23d6-46c5-94a2-215dba2df5d0), log id: e977f72 >2014-08-25 13:47:05,444 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] vdsManager::disposing >2014-08-25 13:47:05,445 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] FINISH, RemoveVdsVDSCommand, log id: e977f72 >2014-08-25 13:47:05,448 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] Correlation ID: 2c9b8481, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was removed by admin. >2014-08-25 13:47:05,448 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-39) [2c9b8481] Lock freed to object EngineLock [exclusiveLocks= key: f2c02bc8-23d6-46c5-94a2-215dba2df5d0 value: VDS >, sharedLocks= ] >2014-08-25 13:47:05,573 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-82) [789eb238] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:47:05,576 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-82) [789eb238] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 608a06d8-ca89-454c-a822-21469c220563 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:47:05,578 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-82) [789eb238] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:47:05,582 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-82) [e7e6819] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:47:05,589 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-82) [e7e6819] Correlation ID: e7e6819, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-08-25 13:47:44,084 INFO [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-1) Registration request: source='10.34.63.137', secured='true', address='10.34.63.137', vdsPort=54321, name='slot-7.rhev.lab.eng.brq.redhat.com', uniqueId='4C4C4544-0052-4C10-8058-B5C04F43354A' >2014-08-25 13:47:44,109 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-1) Running Command: RegisterVds >2014-08-25 13:47:44,290 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-1) [4d71cefb] Running command: AddVdsCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 13:47:44,309 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:47:44,316 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-08-25 13:47:44,318 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] START, RemoveVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b), log id: 3a9a426b >2014-08-25 13:47:44,318 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] FINISH, RemoveVdsVDSCommand, log id: 3a9a426b >2014-08-25 13:47:44,320 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] START, AddVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b), log id: 26f3b35a >2014-08-25 13:47:44,320 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] AddVds - entered , starting logic to add VDS 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b >2014-08-25 13:47:44,321 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] AddVds - VDS 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b was added, will try to add it to the resource manager >2014-08-25 13:47:44,321 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [7777ddf4] Entered VdsManager constructor >2014-08-25 13:47:44,333 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [7777ddf4] Initialize vdsBroker (10.34.63.137,54,321) >2014-08-25 13:47:44,333 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [7777ddf4] VDS 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b was added to the Resource Manager >2014-08-25 13:47:44,334 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [7777ddf4] FINISH, AddVdsVDSCommand, log id: 26f3b35a >2014-08-25 13:47:44,338 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7777ddf4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:47:44,411 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7777ddf4] Correlation ID: 4d71cefb, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was added by Non interactive user. >2014-08-25 13:47:44,411 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-1) [7777ddf4] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: slot-7.rhev.lab.eng.brq.redhat.com, Hostname: 10.34.63.137, UniqueID: 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-08-25 13:47:44,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [7777ddf4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com registered. >2014-08-25 13:47:57,050 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:47:57,050 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:47:57,050 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-4) [572c0db8] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:47:57,056 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:47:57,056 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-4) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 13:47:57,070 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [572c0db8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:47:57,078 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [572c0db8] Correlation ID: 572c0db8, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-08-25 13:47:57,186 INFO [org.ovirt.engine.core.bll.ApproveVdsCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Running command: ApproveVdsCommand internal: false. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:47:57,186 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Before Installation host 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:47:57,201 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 32670559 >2014-08-25 13:47:57,205 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] FINISH, SetVdsStatusVDSCommand, log id: 32670559 >2014-08-25 13:47:57,426 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Installation 10.34.63.137: Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 13:47:57,432 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.137 with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 13:47:57,467 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Installation of 10.34.63.137. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-08-25 13:47:57,485 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-48) SSH execute root@10.34.63.137 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-08-25 13:47:58,623 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Initializing >2014-08-25 13:47:58,629 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Initializing. >2014-08-25 13:47:58,653 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment setup >2014-08-25 13:47:58,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment setup. >2014-08-25 13:47:58,677 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment packages setup >2014-08-25 13:47:58,683 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment packages setup. >2014-08-25 13:47:58,683 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Programs detection >2014-08-25 13:47:58,689 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Programs detection. >2014-08-25 13:47:58,689 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Environment customization >2014-08-25 13:47:58,694 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment customization. >2014-08-25 13:47:58,725 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Host is hypervisor >2014-08-25 13:47:58,731 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Host is hypervisor. >2014-08-25 13:47:58,739 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Logs at host located at: '/tmp/ovirt-host-deploy-20140825114757-e98cee.log' >2014-08-25 13:47:58,745 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20140825114757-e98cee.log'. >2014-08-25 13:47:58,809 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.137 reports unique id 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-08-25 13:47:58,813 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B5C04F43354A to Host 10.34.63.137 >2014-08-25 13:47:58,949 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Setup validation >2014-08-25 13:47:58,955 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Setup validation. >2014-08-25 13:47:59,091 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Hardware supports virtualization >2014-08-25 13:47:59,098 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Hardware supports virtualization. >2014-08-25 13:47:59,098 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Transaction setup >2014-08-25 13:47:59,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction setup. >2014-08-25 13:47:59,104 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Misc configuration >2014-08-25 13:47:59,108 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 13:47:59,109 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Package installation >2014-08-25 13:47:59,116 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Package installation. >2014-08-25 13:47:59,348 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-13) [10c54da5] Initializing Host: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:48:09,828 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Misc configuration >2014-08-25 13:48:09,836 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 13:48:09,888 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Setting time >2014-08-25 13:48:09,894 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Setting time. >2014-08-25 13:48:11,893 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Enrolling certificate >2014-08-25 13:48:11,900 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Enrolling certificate. >2014-08-25 13:48:13,081 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Transaction commit >2014-08-25 13:48:13,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction commit. >2014-08-25 13:48:13,088 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stage: Closing up >2014-08-25 13:48:13,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Closing up. >2014-08-25 13:48:18,008 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Stopping libvirtd >2014-08-25 13:48:18,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stopping libvirtd. >2014-08-25 13:48:18,981 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Starting vdsm >2014-08-25 13:48:18,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Starting vdsm. >2014-08-25 13:48:35,804 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.137: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825134835-10.34.63.137-7777ddf4.log' >2014-08-25 13:48:35,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7777ddf4, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825134835-10.34.63.137-7777ddf4.log'. >2014-08-25 13:48:36,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:48:36,101 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:48:36,625 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:48:36,626 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:48:37,133 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Engine managed to communicate with VDSM agent on host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:48:37,349 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 49e3615e >2014-08-25 13:48:37,352 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] FINISH, SetVdsStatusVDSCommand, log id: 49e3615e >2014-08-25 13:48:37,352 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] After Installation host slot-7.rhev.lab.eng.brq.redhat.com, oVirtNode >2014-08-25 13:48:37,355 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1e31d39c >2014-08-25 13:48:37,362 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] FINISH, SetVdsStatusVDSCommand, log id: 1e31d39c >2014-08-25 13:48:37,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [7777ddf4] Correlation ID: 7777ddf4, Job ID: c265a61c-a354-4ea9-9104-b0e4f6aa47b7, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was successfully approved by user admin. >2014-08-25 13:48:38,454 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [5899e5c4] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,8490a74f-9b7b-4ac7-89ed-dd3ef552b23b]), log id: 6a5e5758 >2014-08-25 13:48:38,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [5899e5c4] FINISH, GetHardwareInfoVDSCommand, log id: 6a5e5758 >2014-08-25 13:48:38,599 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-7) [2b3ca6a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:48:38,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [2b3ca6a] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,8490a74f-9b7b-4ac7-89ed-dd3ef552b23b]), log id: 19c53f83 >2014-08-25 13:48:38,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [2b3ca6a] FINISH, GetHardwareInfoVDSCommand, log id: 19c53f83 >2014-08-25 13:48:38,731 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [2b3ca6a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:48:38,776 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-7) [e524b22] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:48:38,781 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:48:38,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 45c32a66 >2014-08-25 13:50:49,482 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [1517fcff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:50:49,483 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 45c32a66 >2014-08-25 13:50:49,486 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [1517fcff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:50:49,486 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-7) [1517fcff] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:50:49,486 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 13:50:49,491 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [1517fcff] Correlation ID: 1517fcff, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 13:50:49,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-26) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 64221b8a >2014-08-25 13:50:51,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-26) FINISH, ConnectStoragePoolVDSCommand, log id: 64221b8a >2014-08-25 13:50:51,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b), log id: 3248d434 >2014-08-25 13:50:52,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-7) [1517fcff] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3248d434 >2014-08-25 13:50:52,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [1517fcff] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:50:52,064 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-7) [4402bee6] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:50:52,069 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:50:52,079 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:50:52,080 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-20) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:50:55,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus Free, storage pool Default >2014-08-25 13:50:55,819 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] starting spm on vds slot-7.rhev.lab.eng.brq.redhat.com, storage pool Default, prevId -1, LVER 7 >2014-08-25 13:50:55,820 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] START, SpmStartVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=7, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1e3a1a1b >2014-08-25 13:50:55,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] spmStart polling started: taskId = 96357b5a-136b-4eef-9d94-089900e218e0 >2014-08-25 13:51:14,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] spmStart polling ended: taskId = 96357b5a-136b-4eef-9d94-089900e218e0 task status = finished >2014-08-25 13:51:14,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] spmStart polling ended, spm status: SPM >2014-08-25 13:51:14,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, taskId=96357b5a-136b-4eef-9d94-089900e218e0), log id: 666d2cd6 >2014-08-25 13:51:14,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] FINISH, HSMClearTaskVDSCommand, log id: 666d2cd6 >2014-08-25 13:51:14,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4a4bbb8a, log id: 1e3a1a1b >2014-08-25 13:51:14,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] Initialize Irs proxy from vds: 10.34.63.137 >2014-08-25 13:51:14,240 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: 10.34.63.137). >2014-08-25 13:51:14,241 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:51:14,312 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 7cfeb30f >2014-08-25 13:51:14,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 13:51:14,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b), log id: 3464344e >2014-08-25 13:51:14,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 3464344e >2014-08-25 13:51:14,463 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 7cfeb30f >2014-08-25 13:51:14,463 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-15) [5ff2a2bc] Discovered no tasks on Storage Pool Default >2014-08-25 13:52:15,279 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-8) [78551fb0] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:52:15,285 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:52:15,288 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 524a85ff >2014-08-25 13:52:15,288 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] VDS slot-7.rhev.lab.eng.brq.redhat.com is spm and moved from up calling resetIrs. >2014-08-25 13:52:15,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, ignoreStopFailed = false), log id: 278b19c1 >2014-08-25 13:52:15,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] START, SpmStopVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 39f3bca >2014-08-25 13:52:15,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] SpmStopVDSCommand::Stopping SPM on vds slot-7.rhev.lab.eng.brq.redhat.com, pool id 00000002-0002-0002-0002-000000000135 >2014-08-25 13:52:15,447 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] FINISH, SpmStopVDSCommand, log id: 39f3bca >2014-08-25 13:52:15,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] FINISH, ResetIrsVDSCommand, log id: 278b19c1 >2014-08-25 13:52:15,459 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] FINISH, SetVdsStatusVDSCommand, log id: 524a85ff >2014-08-25 13:52:15,501 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-08-25 13:52:15,521 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-35) [78551fb0] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:52:15,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [78551fb0] Correlation ID: 78551fb0, Job ID: 53d5e695-e6ab-4af2-b59f-7dcea12c4591, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-08-25 13:52:16,946 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-78) [632d11a8] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b : slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:52:16,958 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-16) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:52:16,959 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-16) Domain 608a06d8-ca89-454c-a822-21469c220563:iso has recovered from problem. No active host in the DC is reporting it as poblematic, so clearing the domain recovery timer. >2014-08-25 13:52:16,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-78) [632d11a8] START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 79bbec58 >2014-08-25 13:52:19,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-78) [632d11a8] FINISH, DisconnectStoragePoolVDSCommand, log id: 79bbec58 >2014-08-25 13:52:19,873 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-78) [14693abb] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:52:19,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-78) [14693abb] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3597f408 >2014-08-25 13:52:20,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-78) [14693abb] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 3597f408 >2014-08-25 13:52:25,163 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-87) [718febc7] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:52:25,166 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-87) [718febc7] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 608a06d8-ca89-454c-a822-21469c220563 status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:52:25,168 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-87) [718febc7] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-08-25 13:52:25,171 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:52:25,178 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Correlation ID: 1a51a4c3, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default. Setting status to Non Responsive. >2014-08-25 13:53:51,903 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-6) [4e0c8712] Lock Acquired to object EngineLock [exclusiveLocks= key: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b value: VDS >, sharedLocks= ] >2014-08-25 13:53:51,910 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b Type: VDS >2014-08-25 13:53:51,923 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] START, RemoveVdsVDSCommand( HostId = 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b), log id: 5c4cb7b0 >2014-08-25 13:53:51,923 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] vdsManager::disposing >2014-08-25 13:53:51,924 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] FINISH, RemoveVdsVDSCommand, log id: 5c4cb7b0 >2014-08-25 13:53:51,930 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] Correlation ID: 4e0c8712, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was removed by admin. >2014-08-25 13:53:51,930 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-37) [4e0c8712] Lock freed to object EngineLock [exclusiveLocks= key: 8490a74f-9b7b-4ac7-89ed-dd3ef552b23b value: VDS >, sharedLocks= ] >2014-08-25 13:54:41,836 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-3) [3a40254d] Running command: AddVdsCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 13:54:41,850 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 13:54:41,855 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-08-25 13:54:41,858 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] START, RemoveVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 42fd913c >2014-08-25 13:54:41,858 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] FINISH, RemoveVdsVDSCommand, log id: 42fd913c >2014-08-25 13:54:41,859 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] START, AddVdsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 468e4a94 >2014-08-25 13:54:41,860 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] AddVds - entered , starting logic to add VDS db0a9d36-feed-4855-9ea1-cfa0ccc52b0f >2014-08-25 13:54:41,861 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] AddVds - VDS db0a9d36-feed-4855-9ea1-cfa0ccc52b0f was added, will try to add it to the resource manager >2014-08-25 13:54:41,861 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [45a575c9] Entered VdsManager constructor >2014-08-25 13:54:41,874 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [45a575c9] Initialize vdsBroker (slot-7.rhev.lab.eng.brq.redhat.com,54,321) >2014-08-25 13:54:41,874 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [45a575c9] VDS db0a9d36-feed-4855-9ea1-cfa0ccc52b0f was added to the Resource Manager >2014-08-25 13:54:41,875 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [45a575c9] FINISH, AddVdsVDSCommand, log id: 468e4a94 >2014-08-25 13:54:41,883 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [45a575c9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:54:41,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [45a575c9] Correlation ID: 3a40254d, Job ID: 61c2474a-452e-407b-997f-6ce287ab2352, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was added by admin. >2014-08-25 13:54:41,913 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Lock Acquired to object EngineLock [exclusiveLocks= key: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f value: VDS >, sharedLocks= ] >2014-08-25 13:54:41,920 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Running command: InstallVdsCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 13:54:41,920 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Before Installation host db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:54:41,923 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 694be7b0 >2014-08-25 13:54:41,927 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] FINISH, SetVdsStatusVDSCommand, log id: 694be7b0 >2014-08-25 13:54:42,072 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-8) [613d41db] Installation slot-7.rhev.lab.eng.brq.redhat.com: Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-08-25 13:54:42,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [613d41db] Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-08-25 13:54:42,107 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-8) [613d41db] Installation of slot-7.rhev.lab.eng.brq.redhat.com. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-08-25 13:54:42,117 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-8) SSH execute root@slot-7.rhev.lab.eng.brq.redhat.com 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-08-25 13:54:43,162 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Initializing >2014-08-25 13:54:43,168 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Initializing. >2014-08-25 13:54:43,193 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment setup >2014-08-25 13:54:43,200 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment setup. >2014-08-25 13:54:43,209 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment packages setup >2014-08-25 13:54:43,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment packages setup. >2014-08-25 13:54:43,216 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Programs detection >2014-08-25 13:54:43,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Programs detection. >2014-08-25 13:54:43,222 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment customization >2014-08-25 13:54:43,229 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Environment customization. >2014-08-25 13:54:43,267 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Host is hypervisor >2014-08-25 13:54:43,276 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Host is hypervisor. >2014-08-25 13:54:43,285 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20140825115441-1pwms3.log' >2014-08-25 13:54:43,291 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20140825115441-1pwms3.log'. >2014-08-25 13:54:43,332 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host slot-7.rhev.lab.eng.brq.redhat.com reports unique id 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-08-25 13:54:43,355 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B5C04F43354A to Host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:54:43,432 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Setup validation >2014-08-25 13:54:43,438 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Setup validation. >2014-08-25 13:54:43,590 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Hardware supports virtualization >2014-08-25 13:54:43,596 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Hardware supports virtualization. >2014-08-25 13:54:43,596 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction setup >2014-08-25 13:54:43,601 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction setup. >2014-08-25 13:54:43,602 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-08-25 13:54:43,607 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 13:54:43,607 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Package installation >2014-08-25 13:54:43,612 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Package installation. >2014-08-25 13:54:44,877 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-11) [30533713] Initializing Host: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:54:49,311 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-08-25 13:54:49,336 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-08-25 13:54:49,371 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Setting time >2014-08-25 13:54:49,378 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Setting time. >2014-08-25 13:54:51,089 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Enrolling certificate >2014-08-25 13:54:51,095 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Enrolling certificate. >2014-08-25 13:54:52,275 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction commit >2014-08-25 13:54:52,281 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Transaction commit. >2014-08-25 13:54:52,282 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Closing up >2014-08-25 13:54:52,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stage: Closing up. >2014-08-25 13:54:57,800 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stopping libvirtd >2014-08-25 13:54:57,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Stopping libvirtd. >2014-08-25 13:54:58,631 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Starting vdsm >2014-08-25 13:54:58,638 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Starting vdsm. >2014-08-25 13:55:16,413 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825135516-slot-7.rhev.lab.eng.brq.redhat.com-613d41db.log' >2014-08-25 13:55:16,421 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 613d41db, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-7.rhev.lab.eng.brq.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825135516-slot-7.rhev.lab.eng.brq.redhat.com-613d41db.log'. >2014-08-25 13:55:16,739 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:55:16,741 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:55:17,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:55:17,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Command PollVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 13:55:17,760 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-8) [613d41db] Engine managed to communicate with VDSM agent on host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:55:17,978 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5347a526 >2014-08-25 13:55:17,982 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] FINISH, SetVdsStatusVDSCommand, log id: 5347a526 >2014-08-25 13:55:17,982 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] After Installation host slot-7.rhev.lab.eng.brq.redhat.com, oVirtNode >2014-08-25 13:55:17,991 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [613d41db] Correlation ID: 613d41db, Job ID: 61c2474a-452e-407b-997f-6ce287ab2352, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com installed >2014-08-25 13:55:17,997 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-8) [613d41db] Lock freed to object EngineLock [exclusiveLocks= key: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f value: VDS >, sharedLocks= ] >2014-08-25 13:55:20,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-75) [40b03f9] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f]), log id: 1bf9ed47 >2014-08-25 13:55:21,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-75) [40b03f9] FINISH, GetHardwareInfoVDSCommand, log id: 1bf9ed47 >2014-08-25 13:55:21,126 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-75) [77982327] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 13:55:21,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-75) [77982327] START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f]), log id: 7f97e507 >2014-08-25 13:55:21,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-75) [77982327] FINISH, GetHardwareInfoVDSCommand, log id: 7f97e507 >2014-08-25 13:55:21,258 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [77982327] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:55:21,303 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-75) [11595f4a] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:55:21,308 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 13:55:21,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 213bf984 >2014-08-25 13:57:32,050 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to the Storage Domains iso. >2014-08-25 13:57:32,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477, 191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 213bf984 >2014-08-25 13:57:32,053 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: The error message for connection pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 returned by VDSM was: Problem while trying to mount target >2014-08-25 13:57:32,053 ERROR [org.ovirt.engine.core.bll.storage.NFSStorageHelper] (DefaultQuartzScheduler_Worker-75) [1efe22f0] The connection with details pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616 failed because of error code 477 and error message is: problem while trying to mount target >2014-08-25 13:57:32,053 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Host slot-7.rhev.lab.eng.brq.redhat.com storage connection was failed >2014-08-25 13:57:32,058 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Correlation ID: 1efe22f0, Call Stack: null, Custom Event ID: -1, Message: Failed to connect Host slot-7.rhev.lab.eng.brq.redhat.com to Storage Servers >2014-08-25 13:57:32,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, ConnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 1), log id: 2a5a6fec >2014-08-25 13:57:33,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, ConnectStoragePoolVDSCommand, log id: 2a5a6fec >2014-08-25 13:57:33,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] START, SetMOMPolicyParametersVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 32acad01 >2014-08-25 13:57:33,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-75) [1efe22f0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 32acad01 >2014-08-25 13:57:33,621 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [1efe22f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 13:57:33,629 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-75) [62c7d847] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 13:57:33,657 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-75) [404d87cc] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 13:57:33,664 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-48) domain 608a06d8-ca89-454c-a822-21469c220563:iso in problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:57:35,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus Free, storage pool Default >2014-08-25 13:57:35,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] starting spm on vds slot-7.rhev.lab.eng.brq.redhat.com, storage pool Default, prevId -1, LVER 8 >2014-08-25 13:57:35,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] START, SpmStartVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=8, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 26bba3e2 >2014-08-25 13:57:35,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] spmStart polling started: taskId = 36f393d7-1d85-42ef-b6ff-de8cc5517925 >2014-08-25 13:57:56,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] spmStart polling ended: taskId = 36f393d7-1d85-42ef-b6ff-de8cc5517925 task status = finished >2014-08-25 13:57:56,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] spmStart polling ended, spm status: SPM >2014-08-25 13:57:56,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=36f393d7-1d85-42ef-b6ff-de8cc5517925), log id: 18c59b9a >2014-08-25 13:57:56,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] FINISH, HSMClearTaskVDSCommand, log id: 18c59b9a >2014-08-25 13:57:56,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@46f5538e, log id: 26bba3e2 >2014-08-25 13:57:56,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-7) [74b8b675] Initialize Irs proxy from vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:57:56,911 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [74b8b675] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-25 13:57:56,912 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 13:57:56,925 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-32) [74b8b675] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: ad51ea0 >2014-08-25 13:57:56,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-32) [74b8b675] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 13:57:56,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-32) [74b8b675] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 2467b77d >2014-08-25 13:57:57,005 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-32) [74b8b675] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 2467b77d >2014-08-25 13:57:57,005 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-32) [74b8b675] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: ad51ea0 >2014-08-25 13:57:57,006 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-32) [74b8b675] Discovered no tasks on Storage Pool Default >2014-08-25 13:59:40,898 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [436e3703] Lock Acquired to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 13:59:41,001 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-49) [436e3703] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 13:59:41,008 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-49) [436e3703] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 581259df >2014-08-25 13:59:41,360 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-49) [436e3703] FINISH, DeactivateStorageDomainVDSCommand, log id: 581259df >2014-08-25 13:59:41,360 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-49) [436e3703] Lock freed to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 13:59:41,364 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-11) [436e3703] After deactivate treatment vds: slot-7.rhev.lab.eng.brq.redhat.com,pool Default >2014-08-25 13:59:41,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) [436e3703] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=1), log id: 746d7741 >2014-08-25 13:59:41,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-11) [436e3703] FINISH, RefreshStoragePoolVDSCommand, log id: 746d7741 >2014-08-25 13:59:41,384 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-49) [4b6f1b5e] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 13:59:41,387 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4b6f1b5e] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 8d3c591 >2014-08-25 13:59:41,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [4b6f1b5e] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=477}, log id: 8d3c591 >2014-08-25 13:59:41,565 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [4b6f1b5e] Correlation ID: 436e3703, Job ID: 87791af7-8dc9-4971-8c2c-bd4e87a1611b, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso (Data Center Default) was deactivated by admin >2014-08-25 13:59:44,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-20) Domain 608a06d8-ca89-454c-a822-21469c220563:iso recovered from problem. vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 13:59:44,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-20) Domain 608a06d8-ca89-454c-a822-21469c220563:iso has recovered from problem. No active host in the DC is reporting it as problematic, so clearing the domain recovery timer. >2014-08-25 14:08:04,289 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:11:12,539 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [7e147d49] Lock Acquired to object EngineLock [exclusiveLocks= key: 99938ede-8d9a-4f22-99f5-c73771944ded value: STORAGE >, sharedLocks= ] >2014-08-25 14:11:12,560 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-30) [7e147d49] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 99938ede-8d9a-4f22-99f5-c73771944ded Type: Storage >2014-08-25 14:11:12,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-30) [7e147d49] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 99938ede-8d9a-4f22-99f5-c73771944ded, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 209878b4 >2014-08-25 14:11:12,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-30) [7e147d49] FINISH, DeactivateStorageDomainVDSCommand, log id: 209878b4 >2014-08-25 14:11:12,707 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-30) [7e147d49] Lock freed to object EngineLock [exclusiveLocks= key: 99938ede-8d9a-4f22-99f5-c73771944ded value: STORAGE >, sharedLocks= ] >2014-08-25 14:11:12,709 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-18) [7e147d49] After deactivate treatment vds: slot-7.rhev.lab.eng.brq.redhat.com,pool Default >2014-08-25 14:11:12,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-18) [7e147d49] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=1), log id: 1bbf0f0a >2014-08-25 14:11:12,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-18) [7e147d49] FINISH, RefreshStoragePoolVDSCommand, log id: 1bbf0f0a >2014-08-25 14:11:12,728 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-30) [6c0c6591] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:11:12,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [6c0c6591] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: c1adaae >2014-08-25 14:11:12,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-30) [6c0c6591] FINISH, DisconnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0}, log id: c1adaae >2014-08-25 14:11:12,998 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-30) [6c0c6591] Correlation ID: 7e147d49, Job ID: ba2b2ca9-637a-4c6a-b43f-294e4541ac40, Call Stack: null, Custom Event ID: -1, Message: Storage Domain export_domain (Data Center Default) was deactivated by admin >2014-08-25 14:11:21,201 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 99938ede-8d9a-4f22-99f5-c73771944ded Type: Storage >2014-08-25 14:11:21,202 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Start detach storage domain >2014-08-25 14:11:21,205 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Detach storage domain: before connect >2014-08-25 14:11:21,210 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-45) [25dbedd5] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:11:21,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [25dbedd5] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1ea293fb >2014-08-25 14:11:21,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [25dbedd5] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0}, log id: 1ea293fb >2014-08-25 14:11:21,453 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Detach storage domain: after connect >2014-08-25 14:11:21,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 99938ede-8d9a-4f22-99f5-c73771944ded, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 4da67ff2 >2014-08-25 14:11:21,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] FINISH, DetachStorageDomainVDSCommand, log id: 4da67ff2 >2014-08-25 14:11:21,848 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Detach storage domain: after detach in vds >2014-08-25 14:11:21,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-20) [7ed60cdf] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=1), log id: 51c49ae8 >2014-08-25 14:11:21,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-20) [7ed60cdf] FINISH, RefreshStoragePoolVDSCommand, log id: 51c49ae8 >2014-08-25 14:11:21,869 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-20) [438e4263] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:11:21,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [438e4263] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20016c52 >2014-08-25 14:11:22,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-20) [438e4263] FINISH, DisconnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0}, log id: 20016c52 >2014-08-25 14:11:22,103 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Detach storage domain: after disconnect storage >2014-08-25 14:11:22,116 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] End detach storage domain >2014-08-25 14:11:22,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [7ed60cdf] Correlation ID: 7ed60cdf, Job ID: 33bbb809-8102-4e70-ac6d-c10aaddd4607, Call Stack: null, Custom Event ID: -1, Message: Storage Domain export_domain was detached from Data Center Default by admin >2014-08-25 14:11:27,557 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 14:11:27,557 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Start detach storage domain >2014-08-25 14:11:27,564 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Detach storage domain: before connect >2014-08-25 14:11:27,567 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-46) [4e3428d7] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:11:27,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [4e3428d7] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 167f83f6 >2014-08-25 14:11:27,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-46) [4e3428d7] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 167f83f6 >2014-08-25 14:11:27,744 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Detach storage domain: after connect >2014-08-25 14:11:27,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1, force = false), log id: 10b09ed1 >2014-08-25 14:11:39,241 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [21699fe] Lock Acquired to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:11:39,256 WARN [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [21699fe] CanDoAction of action DeactivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_MASTER_WITH_LOCKED_DOMAINS >2014-08-25 14:11:39,256 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-8) [21699fe] Lock freed to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:11:49,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] FINISH, DetachStorageDomainVDSCommand, log id: 10b09ed1 >2014-08-25 14:11:49,667 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Detach storage domain: after detach in vds >2014-08-25 14:11:49,673 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-29) [6f2d40d6] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=1), log id: 1d509edc >2014-08-25 14:11:49,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-29) [6f2d40d6] FINISH, RefreshStoragePoolVDSCommand, log id: 1d509edc >2014-08-25 14:11:49,798 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-29) [1cbb20f1] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:11:49,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [1cbb20f1] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: ede1715 >2014-08-25 14:11:50,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [1cbb20f1] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: ede1715 >2014-08-25 14:11:50,029 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Detach storage domain: after disconnect storage >2014-08-25 14:11:50,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] START, ResetISOPathVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 60eef41b >2014-08-25 14:11:50,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] FINISH, ResetISOPathVDSCommand, log id: 60eef41b >2014-08-25 14:11:50,035 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] End detach storage domain >2014-08-25 14:11:50,041 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [6f2d40d6] Correlation ID: 6f2d40d6, Job ID: 7eba6bae-668e-4965-8c47-1917dba07eb8, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso was detached from Data Center Default by admin >2014-08-25 14:13:31,919 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [7b228ffa] Lock Acquired to object EngineLock [exclusiveLocks= key: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah value: STORAGE_CONNECTION >, sharedLocks= ] >2014-08-25 14:13:31,934 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [7b228ffa] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:13:31,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [7b228ffa] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21b59b96 >2014-08-25 14:13:32,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [7b228ffa] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 21b59b96 >2014-08-25 14:13:32,087 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [7b228ffa] Lock freed to object EngineLock [exclusiveLocks= key: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah value: STORAGE_CONNECTION >, sharedLocks= ] >2014-08-25 14:13:32,307 INFO [org.ovirt.engine.core.bll.storage.AddNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] Running command: AddNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:13:32,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b73b31c >2014-08-25 14:13:32,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 7b73b31c >2014-08-25 14:13:32,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] START, CreateStorageDomainVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storageDomain=org.ovirt.engine.core.common.businessentities.StorageDomainStatic@217d3d4d, args=10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah), log id: 41d23775 >2014-08-25 14:13:34,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] FINISH, CreateStorageDomainVDSCommand, log id: 41d23775 >2014-08-25 14:13:34,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] START, GetStorageDomainStatsVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storageDomainId=14d75c12-42cd-4215-b4a8-e2a46ee83005), log id: 1e75afe0 >2014-08-25 14:13:34,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-9) [beef0e3] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.StorageDomain@2eece298, log id: 1e75afe0 >2014-08-25 14:13:34,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [beef0e3] Correlation ID: beef0e3, Job ID: 2ff5df49-ef35-480e-a699-0d0adc92243c, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test was added by admin >2014-08-25 14:13:34,406 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-6) [732748cc] Running command: DisconnectStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:13:34,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [732748cc] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2cf90bce >2014-08-25 14:13:34,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-6) [732748cc] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 2cf90bce >2014-08-25 14:13:34,683 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-7) [9779df3] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-08-25 14:13:34,713 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-27) [b595957] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:13:34,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [b595957] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5def6f1d >2014-08-25 14:13:34,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [b595957] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 5def6f1d >2014-08-25 14:13:34,826 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [9779df3] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005), log id: 299d1ce5 >2014-08-25 14:13:59,691 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [9779df3] FINISH, AttachStorageDomainVDSCommand, log id: 299d1ce5 >2014-08-25 14:13:59,699 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] Lock Acquired to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >, sharedLocks= ] >2014-08-25 14:13:59,709 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-08-25 14:13:59,715 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] Lock freed to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >, sharedLocks= ] >2014-08-25 14:13:59,715 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/25/14 2:13 PM >2014-08-25 14:13:59,718 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-1) [69af505f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:13:59,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [69af505f] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 53f7e891 >2014-08-25 14:13:59,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-1) [69af505f] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 53f7e891 >2014-08-25 14:13:59,942 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [480db7e] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005), log id: 43a89231 >2014-08-25 14:14:00,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-7) [480db7e] FINISH, ActivateStorageDomainVDSCommand, log id: 43a89231 >2014-08-25 14:14:00,248 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] ActivateStorage Domain. After Connect all hosts to pool. Time:8/25/14 2:14 PM >2014-08-25 14:14:00,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-2) [480db7e] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=1), log id: 7b0c23f8 >2014-08-25 14:14:00,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-2) [480db7e] FINISH, RefreshStoragePoolVDSCommand, log id: 7b0c23f8 >2014-08-25 14:14:00,341 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-2) [480db7e] Refreshed vds slot-7.rhev.lab.eng.brq.redhat.com in pool Default >2014-08-25 14:14:00,345 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [480db7e] ActivateStorage Domain. After change storage pool status in vds. Time:8/25/14 2:14 PM >2014-08-25 14:14:00,381 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [480db7e] Correlation ID: 480db7e, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test (Data Center Default) was activated by admin >2014-08-25 14:14:00,396 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [480db7e] Correlation ID: 9779df3, Job ID: 727a50fe-ad65-45cb-ac48-68c8b19db695, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test was attached to Data Center Default by admin >2014-08-25 14:17:15,019 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [4d1c1d26] Lock Acquired to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:17:15,144 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-25) [4d1c1d26] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:17:15,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4d1c1d26] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 2), log id: 499353ad >2014-08-25 14:17:19,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-25) [4d1c1d26] FINISH, DeactivateStorageDomainVDSCommand, log id: 499353ad >2014-08-25 14:17:19,022 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-25) [4d1c1d26] Lock freed to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:17:19,024 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-3) [4d1c1d26] After deactivate treatment vds: slot-7.rhev.lab.eng.brq.redhat.com,pool Default >2014-08-25 14:17:19,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [4d1c1d26] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion=2), log id: 4d5aa4b1 >2014-08-25 14:17:19,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [4d1c1d26] FINISH, RefreshStoragePoolVDSCommand, log id: 4d5aa4b1 >2014-08-25 14:17:19,039 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-25) [6cedbeed] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:17:19,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [6cedbeed] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6184769e >2014-08-25 14:17:19,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [6cedbeed] FINISH, DisconnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 6184769e >2014-08-25 14:17:19,262 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [6cedbeed] Correlation ID: 4d1c1d26, Job ID: 7860eb4d-3653-49fe-8a63-5ca7faa03f96, Call Stack: null, Custom Event ID: -1, Message: Storage Domain n2 (Data Center Default) was deactivated by admin >2014-08-25 14:17:24,900 WARN [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (ajp-/127.0.0.1:8702-4) [5f7ff76d] CanDoAction of action DetachStorageDomainFromPool failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DETACH,ERROR_CANNOT_DETACH_STORAGE_DOMAIN_WITH_IMAGES >2014-08-25 14:17:30,125 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-3) [4a71a438] Lock Acquired to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >, sharedLocks= ] >2014-08-25 14:17:30,172 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:17:30,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] Lock freed to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >, sharedLocks= ] >2014-08-25 14:17:30,176 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/25/14 2:17 PM >2014-08-25 14:17:30,179 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-38) [38cc967d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:17:30,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [38cc967d] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 37a7862c >2014-08-25 14:17:30,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [38cc967d] FINISH, ConnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 37a7862c >2014-08-25 14:17:30,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97), log id: 1c1205a0 >2014-08-25 14:17:30,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] FINISH, ActivateStorageDomainVDSCommand, log id: 1c1205a0 >2014-08-25 14:17:30,568 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] ActivateStorage Domain. After Connect all hosts to pool. Time:8/25/14 2:17 PM >2014-08-25 14:17:30,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4a71a438] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion=2), log id: 57428af6 >2014-08-25 14:17:30,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4a71a438] FINISH, RefreshStoragePoolVDSCommand, log id: 57428af6 >2014-08-25 14:17:30,638 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-43) [4a71a438] Refreshed vds slot-7.rhev.lab.eng.brq.redhat.com in pool Default >2014-08-25 14:17:30,642 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-35) [4a71a438] ActivateStorage Domain. After change storage pool status in vds. Time:8/25/14 2:17 PM >2014-08-25 14:17:30,649 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [4a71a438] Correlation ID: 4a71a438, Job ID: 40d37314-2b6e-468b-94a5-1d3439a46f55, Call Stack: null, Custom Event ID: -1, Message: Storage Domain n2 (Data Center Default) was activated by admin >2014-08-25 14:17:35,149 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [4efabdaf] Lock Acquired to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:17:35,229 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-21) [4efabdaf] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-08-25 14:17:35,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4efabdaf] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: 204ddbfd >2014-08-25 14:17:55,072 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:17:56,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-21) [4efabdaf] FINISH, DeactivateStorageDomainVDSCommand, log id: 204ddbfd >2014-08-25 14:17:56,041 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-21) [4efabdaf] Lock freed to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >key: 00000002-0002-0002-0002-000000000135 value: POOL >, sharedLocks= ] >2014-08-25 14:17:56,046 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-3) [4efabdaf] After deactivate treatment vds: slot-7.rhev.lab.eng.brq.redhat.com,pool Default >2014-08-25 14:17:56,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [4efabdaf] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 75beb4c0 >2014-08-25 14:17:56,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [4efabdaf] FINISH, RefreshStoragePoolVDSCommand, log id: 75beb4c0 >2014-08-25 14:17:56,090 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-21) [740e852] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:17:56,091 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [740e852] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5e3d8a17 >2014-08-25 14:17:56,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-21) [740e852] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 5e3d8a17 >2014-08-25 14:17:56,321 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [740e852] Correlation ID: 4efabdaf, Job ID: 57a4adcd-1300-41c9-84e4-602979ce0e8c, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test (Data Center Default) was deactivated by admin >2014-08-25 14:18:10,214 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:18:45,593 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-08-25 14:18:45,593 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Start detach storage domain >2014-08-25 14:18:45,596 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Detach storage domain: before connect >2014-08-25 14:18:45,599 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-4) [7b1909df] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:18:45,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7b1909df] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a09898d >2014-08-25 14:18:45,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7b1909df] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 4a09898d >2014-08-25 14:18:45,709 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Detach storage domain: after connect >2014-08-25 14:18:45,710 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 3, force = false), log id: 1e109f0f >2014-08-25 14:18:45,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] FINISH, DetachStorageDomainVDSCommand, log id: 1e109f0f >2014-08-25 14:18:45,992 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Detach storage domain: after detach in vds >2014-08-25 14:18:45,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-49) [56bf2e84] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 6717ebac >2014-08-25 14:18:46,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-49) [56bf2e84] FINISH, RefreshStoragePoolVDSCommand, log id: 6717ebac >2014-08-25 14:18:46,013 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-49) [681dda27] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:18:46,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [681dda27] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 21d331d6 >2014-08-25 14:18:46,177 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [681dda27] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 21d331d6 >2014-08-25 14:18:46,178 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Detach storage domain: after disconnect storage >2014-08-25 14:18:46,182 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] End detach storage domain >2014-08-25 14:18:46,188 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [56bf2e84] Correlation ID: 56bf2e84, Job ID: 5e3d50c7-b250-454b-8d80-cbe58205f870, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test was detached from Data Center Default by admin >2014-08-25 14:24:08,409 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [3c271d2b] Lock Acquired to object EngineLock [exclusiveLocks= key: jebatrhevh value: VM_NAME >, sharedLocks= ] >2014-08-25 14:24:08,473 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [3c271d2b] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 14:24:08,729 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [3c271d2b] Correlation ID: 3c271d2b, Job ID: 408d452c-588e-4c36-9931-7cf3fbcd4a0a, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh was created by admin. >2014-08-25 14:24:08,733 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [3c271d2b] Lock freed to object EngineLock [exclusiveLocks= key: jebatrhevh value: VM_NAME >, sharedLocks= ] >2014-08-25 14:24:09,730 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-4) [3850fff9] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:24:34,264 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [30bf41e] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM_DISK_BOOT >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:24:34,307 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [30bf41e] Running command: AddDiskCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM, ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:24:34,546 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [361940e1] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:24:34,604 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [361940e1] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM_DISK_BOOT >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:24:34,606 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [361940e1] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageSizeInBytes = 10737418240, volumeFormat = RAW, newImageId = 9b809bd0-c89e-46c8-b088-82953fa434dc, newImageDescription = ), log id: 720ab7ff >2014-08-25 14:24:34,606 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [361940e1] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 14:24:34,928 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [361940e1] FINISH, CreateImageVDSCommand, return: 9b809bd0-c89e-46c8-b088-82953fa434dc, log id: 720ab7ff >2014-08-25 14:24:35,134 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [361940e1] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command b87b5baa-e1f3-494e-9cf1-14bf7734dcee >2014-08-25 14:24:35,136 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [361940e1] CommandMultiAsyncTasks::AttachTask: Attaching task 90c392b6-4ea4-4233-9c8c-38799d69cfda to command b87b5baa-e1f3-494e-9cf1-14bf7734dcee. >2014-08-25 14:24:35,155 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [361940e1] Adding task 90c392b6-4ea4-4233-9c8c-38799d69cfda (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 14:24:35,192 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [361940e1] Correlation ID: 30bf41e, Job ID: be140983-56cb-4d02-811e-dd6e8f58f6e3, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of jebatrhevh_Disk1 was initiated on VM jebatrhevh by admin. >2014-08-25 14:24:35,192 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [361940e1] BaseAsyncTask::startPollingTask: Starting to poll task 90c392b6-4ea4-4233-9c8c-38799d69cfda. >2014-08-25 14:24:37,137 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) [371f8ade] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-25 14:24:37,166 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] SPMAsyncTask::PollTask: Polling task 90c392b6-4ea4-4233-9c8c-38799d69cfda (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 14:24:37,177 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] BaseAsyncTask::OnTaskEndSuccess: Task 90c392b6-4ea4-4233-9c8c-38799d69cfda (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 14:24:37,177 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] CommandAsyncTask::EndActionIfNecessary: All tasks of command b87b5baa-e1f3-494e-9cf1-14bf7734dcee has ended -> executing endAction >2014-08-25 14:24:37,178 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: b87b5baa-e1f3-494e-9cf1-14bf7734dcee): calling endAction . >2014-08-25 14:24:37,180 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-1) [371f8ade] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-25 14:24:37,201 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-1) [30bf41e] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-25 14:24:37,211 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-1) [361940e1] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-25 14:24:37,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-1) [361940e1] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageId = 9b809bd0-c89e-46c8-b088-82953fa434dc), log id: 11bac43b >2014-08-25 14:24:37,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-1) [361940e1] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@8fe115f5, log id: 11bac43b >2014-08-25 14:24:37,330 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) Correlation ID: 30bf41e, Job ID: be140983-56cb-4d02-811e-dd6e8f58f6e3, Call Stack: null, Custom Event ID: -1, Message: The disk jebatrhevh_Disk1 was successfully added to VM jebatrhevh. >2014-08-25 14:24:37,331 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-1) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-25 14:24:37,331 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-1) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-25 14:24:37,334 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-1) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 90c392b6-4ea4-4233-9c8c-38799d69cfda >2014-08-25 14:24:37,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-1) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 90c392b6-4ea4-4233-9c8c-38799d69cfda), log id: 70617ce5 >2014-08-25 14:24:37,336 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-1) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=90c392b6-4ea4-4233-9c8c-38799d69cfda), log id: 104ed807 >2014-08-25 14:24:37,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-1) FINISH, HSMClearTaskVDSCommand, log id: 104ed807 >2014-08-25 14:24:37,371 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-1) FINISH, SPMClearTaskVDSCommand, log id: 70617ce5 >2014-08-25 14:24:37,379 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-1) BaseAsyncTask::RemoveTaskFromDB: Removed task 90c392b6-4ea4-4233-9c8c-38799d69cfda from DataBase >2014-08-25 14:24:37,379 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-1) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity b87b5baa-e1f3-494e-9cf1-14bf7734dcee >2014-08-25 14:24:40,380 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-6) [6d614ea6] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:24:40,427 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [6d614ea6] START, IsVmDuringInitiatingVDSCommand( vmId = 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3), log id: 5dab5bb4 >2014-08-25 14:24:40,427 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-6) [6d614ea6] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5dab5bb4 >2014-08-25 14:24:40,499 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] Running command: RunVmCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:24:40,589 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] START, CreateVmVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, vm=VM [jebatrhevh]), log id: 7da810a8 >2014-08-25 14:24:40,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] START, CreateVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, vm=VM [jebatrhevh]), log id: 19440a2d >2014-08-25 14:24:40,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=92d6c670-9fb8-48df-b97d-53c504079fe3}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=dfb732c2-05e8-47a5-b41a-4c756511a76f}, {shared=false, volumeID=9b809bd0-c89e-46c8-b088-82953fa434dc, index=0, iface=virtio, imageID=89524120-a4cb-4f8e-98e7-35b3062aeee9, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=00000002-0002-0002-0002-000000000135, format=raw, type=disk, readonly=false, deviceId=89524120-a4cb-4f8e-98e7-35b3062aeee9}, {nicModel=pv, bootOrder=1, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0d, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=763cd95d-1b6a-4efa-80ca-95f8be327699}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=1d02d789-6b5f-484f-99c3-521e9d8ea53f}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=73827140-21af-4201-afc9-f7914f4f9e20}],acpiEnable=true,vmName=jebatrhevh,cpuType=Westmere,custom={} >2014-08-25 14:24:40,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] FINISH, CreateVDSCommand, log id: 19440a2d >2014-08-25 14:24:40,785 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7da810a8 >2014-08-25 14:24:40,785 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:24:40,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [6d614ea6] Correlation ID: 6d614ea6, Job ID: 7a06d2b8-c76c-4d68-8e49-9bbf3b236247, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh was started by admin (Host: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-25 14:24:44,003 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-84) [330a5600] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from WaitForLaunch --> PoweringUp >2014-08-25 14:24:44,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 724d9d18 >2014-08-25 14:24:44,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=12911, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@4584cd48, vmName=jebatrhevh, cpuType=Westmere}], log id: 724d9d18 >2014-08-25 14:24:45,531 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-2) [23301d8e] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:24:45,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [23301d8e] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=Ex68NsDjRmta, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7922145b >2014-08-25 14:24:45,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [23301d8e] FINISH, SetVmTicketVDSCommand, log id: 7922145b >2014-08-25 14:24:45,617 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [23301d8e] Correlation ID: 23301d8e, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 14:24:53,456 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-5) [618bccaf] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:24:53,462 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [618bccaf] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=/D8CV+dH53I+, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 66d43c2f >2014-08-25 14:24:53,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [618bccaf] FINISH, SetVmTicketVDSCommand, log id: 66d43c2f >2014-08-25 14:24:53,494 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [618bccaf] Correlation ID: 618bccaf, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 14:24:57,922 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [d161f12] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:24:57,927 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [d161f12] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=iEvAhqbVlvAY, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 6427a5dc >2014-08-25 14:24:57,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [d161f12] FINISH, SetVmTicketVDSCommand, log id: 6427a5dc >2014-08-25 14:24:57,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [d161f12] Correlation ID: d161f12, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 14:25:03,089 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [61ff5962] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:25:03,092 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [61ff5962] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=EQP12lIbGQLz, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 3a8b9a0e >2014-08-25 14:25:03,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [61ff5962] FINISH, SetVmTicketVDSCommand, log id: 3a8b9a0e >2014-08-25 14:25:03,137 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [61ff5962] Correlation ID: 61ff5962, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 14:25:10,253 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [55beba23] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:25:10,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [55beba23] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=CbgYcDg76IQ6, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 55806e5f >2014-08-25 14:25:10,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [55beba23] FINISH, SetVmTicketVDSCommand, log id: 55806e5f >2014-08-25 14:25:10,308 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [55beba23] Correlation ID: 55beba23, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 14:25:14,504 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [7c5190b2] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM jebatrhevh. >2014-08-25 14:25:41,758 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from PoweringUp --> Up >2014-08-25 14:25:41,769 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] Correlation ID: 6d614ea6, Job ID: 7a06d2b8-c76c-4d68-8e49-9bbf3b236247, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh started on Host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 14:25:44,847 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:25:46,081 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) [26243347] Setting new tasks map. The map contains now 0 tasks >2014-08-25 14:25:46,081 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-1) [26243347] Cleared all tasks of pool 00000002-0002-0002-0002-000000000135. >2014-08-25 14:27:09,553 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-7) [31119a16] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-08-25 14:27:09,566 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:27:09,571 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-08-25 14:27:09,573 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] START, RemoveVdsVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 391402c >2014-08-25 14:27:09,573 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] FINISH, RemoveVdsVDSCommand, log id: 391402c >2014-08-25 14:27:09,574 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] START, AddVdsVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 3d957407 >2014-08-25 14:27:09,574 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] AddVds - entered , starting logic to add VDS fd905932-df0d-4553-9fe9-af628494ea89 >2014-08-25 14:27:09,575 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] AddVds - VDS fd905932-df0d-4553-9fe9-af628494ea89 was added, will try to add it to the resource manager >2014-08-25 14:27:09,575 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [1656f56f] Entered VdsManager constructor >2014-08-25 14:27:09,587 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [1656f56f] Initialize vdsBroker (10.34.62.208,54,321) >2014-08-25 14:27:09,588 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-7) [1656f56f] VDS fd905932-df0d-4553-9fe9-af628494ea89 was added to the Resource Manager >2014-08-25 14:27:09,588 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [1656f56f] FINISH, AddVdsVDSCommand, log id: 3d957407 >2014-08-25 14:27:09,592 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [1656f56f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-08-25 14:27:09,605 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [1656f56f] Correlation ID: 31119a16, Job ID: e93ad3fe-259d-48f1-b7a3-f882ad199548, Call Stack: null, Custom Event ID: -1, Message: Host rack was added by admin. >2014-08-25 14:27:09,609 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Lock Acquired to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:27:09,616 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Running command: InstallVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:27:09,616 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Before Installation host fd905932-df0d-4553-9fe9-af628494ea89, rack >2014-08-25 14:27:09,619 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7098bd5 >2014-08-25 14:27:09,622 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] FINISH, SetVdsStatusVDSCommand, log id: 7098bd5 >2014-08-25 14:27:09,693 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Installation 10.34.62.208: Connected to host 10.34.62.208 with SSH key fingerprint: 3f:fe:39:f2:21:7b:9c:a0:53:49:a6:35:b0:6c:4a:ff >2014-08-25 14:27:09,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Connected to host 10.34.62.208 with SSH key fingerprint: 3f:fe:39:f2:21:7b:9c:a0:53:49:a6:35:b0:6c:4a:ff. >2014-08-25 14:27:09,718 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Installation of 10.34.62.208. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-08-25 14:27:09,731 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-41) SSH execute root@10.34.62.208 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-08-25 14:27:12,591 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-29) [510b7b06] Initializing Host: rack >2014-08-25 14:27:15,945 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Initializing >2014-08-25 14:27:15,951 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Initializing. >2014-08-25 14:27:15,961 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Environment setup >2014-08-25 14:27:15,967 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment setup. >2014-08-25 14:27:15,968 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Environment packages setup >2014-08-25 14:27:15,973 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment packages setup. >2014-08-25 14:27:15,973 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Programs detection >2014-08-25 14:27:15,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Programs detection. >2014-08-25 14:27:15,978 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Environment customization >2014-08-25 14:27:15,984 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment customization. >2014-08-25 14:27:15,999 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Logs at host located at: '/tmp/ovirt-host-deploy-20140825142714-rpf5sd.log' >2014-08-25 14:27:16,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Logs at host located at: '/tmp/ovirt-host-deploy-20140825142714-rpf5sd.log'. >2014-08-25 14:27:16,072 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.62.208 reports unique id 4C4C4544-0034-5310-8052-B4C04F4A354A >2014-08-25 14:27:16,099 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0034-5310-8052-B4C04F4A354A to Host 10.34.62.208 >2014-08-25 14:27:16,147 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Setup validation >2014-08-25 14:27:16,153 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Setup validation. >2014-08-25 14:27:16,187 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Hardware supports virtualization >2014-08-25 14:27:16,194 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Hardware supports virtualization. >2014-08-25 14:27:16,194 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Transaction setup >2014-08-25 14:27:16,199 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Transaction setup. >2014-08-25 14:27:16,199 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Misc configuration >2014-08-25 14:27:16,204 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Misc configuration. >2014-08-25 14:27:16,204 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Package installation >2014-08-25 14:27:16,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Package installation. >2014-08-25 14:27:25,718 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Misc configuration >2014-08-25 14:27:25,724 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Misc configuration. >2014-08-25 14:27:25,794 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Setting time >2014-08-25 14:27:25,801 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Setting time. >2014-08-25 14:27:27,405 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Enrolling certificate >2014-08-25 14:27:27,413 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Enrolling certificate. >2014-08-25 14:27:28,701 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Transaction commit >2014-08-25 14:27:28,707 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Transaction commit. >2014-08-25 14:27:28,708 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Closing up >2014-08-25 14:27:28,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Closing up. >2014-08-25 14:27:29,588 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stopping libvirtd >2014-08-25 14:27:29,595 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stopping libvirtd. >2014-08-25 14:27:29,823 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Starting vdsm >2014-08-25 14:27:29,829 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Starting vdsm. >2014-08-25 14:27:31,522 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Pre-termination >2014-08-25 14:27:31,528 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Pre-termination. >2014-08-25 14:27:31,535 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825142731-10.34.62.208-4b4299cc.log' >2014-08-25 14:27:31,541 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140825142731-10.34.62.208-4b4299cc.log'. >2014-08-25 14:27:31,735 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.208: Stage: Termination >2014-08-25 14:27:31,740 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 4b4299cc, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Termination. >2014-08-25 14:27:31,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 14:27:31,833 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-08-25 14:27:32,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 14:27:32,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-08-25 14:27:32,964 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Engine managed to communicate with VDSM agent on host rack >2014-08-25 14:27:33,215 WARN [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] The lastClientInterface ovirtmgmt of host rack is not a valid interface for the mangement network. If the interface is a bridge, it should be torn-down manually. >2014-08-25 14:27:33,217 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Host installation failed for host fd905932-df0d-4553-9fe9-af628494ea89, rack.: org.ovirt.engine.core.bll.InstallVdsCommand$VdsInstallException: Failed to configure management network on the host > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:357) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:254) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:156) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1133) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1218) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1894) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1238) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:351) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:415) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:394) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.7.0_55] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [rt.jar:1.7.0_55] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_55] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_55] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:259) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:398) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:242) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.3.2.Final-redhat-2] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:163) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:97) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_55] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_55] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_55] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_55] >Caused by: org.ovirt.engine.core.bll.network.NetworkConfigurator$NetworkConfiguratorException: lastClientIface ovirtmgmt is not a valid interface for management network > at org.ovirt.engine.core.bll.network.NetworkConfigurator.findNicToSetupManagementNetwork(NetworkConfigurator.java:157) [bll.jar:] > at org.ovirt.engine.core.bll.network.NetworkConfigurator.createManagementNetworkIfRequired(NetworkConfigurator.java:61) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:349) [bll.jar:] > ... 61 more > >2014-08-25 14:27:33,223 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=NonOperational, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 55a674f9 >2014-08-25 14:27:33,230 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] FINISH, SetVdsStatusVDSCommand, log id: 55a674f9 >2014-08-25 14:27:33,236 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Correlation ID: 4b4299cc, Job ID: e93ad3fe-259d-48f1-b7a3-f882ad199548, Call Stack: null, Custom Event ID: -1, Message: Host rack installation failed. Failed to configure management network on the host. >2014-08-25 14:27:33,240 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-41) [4b4299cc] Lock freed to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [26243347] Autorecovering 1 hosts >2014-08-25 14:30:00,012 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-1) [26243347] Autorecovering hosts id: fd905932-df0d-4553-9fe9-af628494ea89, name : rack >2014-08-25 14:30:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Lock Acquired to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:30:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Running command: ActivateVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Before acquiring lock in order to prevent monitoring for host rack from data-center datacenter_None >2014-08-25 14:30:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Lock acquired, from now a monitoring of host will be skipped for host rack from data-center datacenter_None >2014-08-25 14:30:00,017 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 6f4875a3 >2014-08-25 14:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] FINISH, SetVdsStatusVDSCommand, log id: 6f4875a3 >2014-08-25 14:30:00,049 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Activate finished. Lock released. Monitoring can run now for host rack from data-center datacenter_None >2014-08-25 14:30:00,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Correlation ID: 34ba8ae0, Call Stack: null, Custom Event ID: -1, Message: Host rack was autorecovered. >2014-08-25 14:30:00,057 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] Lock freed to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:30:00,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [24f8127f] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89]), log id: 173031d >2014-08-25 14:30:00,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [24f8127f] FINISH, GetHardwareInfoVDSCommand, log id: 173031d >2014-08-25 14:30:00,905 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [412bb6c] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:00,907 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [412bb6c] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE, stopSpmFailureLogged=false), log id: 412b2183 >2014-08-25 14:30:00,911 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [412bb6c] FINISH, SetVdsStatusVDSCommand, log id: 412b2183 >2014-08-25 14:30:00,914 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [412bb6c] Host rack is set to Non-Operational, it is missing the following networks: rhevm >2014-08-25 14:30:00,951 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [412bb6c] Correlation ID: 412bb6c, Job ID: 18ae88ba-2bc9-4032-82ea-9e970f444f41, Call Stack: null, Custom Event ID: -1, Message: Host rack does not comply with the cluster cluster_None networks, the following networks are missing on host: 'rhevm' >2014-08-25 14:30:00,965 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-28) [2ab20220] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:01,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [2ab20220] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89]), log id: 2a6bf1d0 >2014-08-25 14:30:01,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [2ab20220] FINISH, GetHardwareInfoVDSCommand, log id: 2a6bf1d0 >2014-08-25 14:30:01,094 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [5d33659d] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:01,096 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [5d33659d] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE, stopSpmFailureLogged=false), log id: 1f0156ef >2014-08-25 14:30:01,099 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [5d33659d] FINISH, SetVdsStatusVDSCommand, log id: 1f0156ef >2014-08-25 14:30:01,109 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [5d33659d] Host rack is set to Non-Operational, it is missing the following networks: rhevm >2014-08-25 14:30:01,121 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-28) [2026d762] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:01,130 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [2026d762] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host rack. >2014-08-25 14:30:01,145 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-28) [16daafd4] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:01,149 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-28) [7e433129] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:30:01,150 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) [7e433129] Host fd905932-df0d-4553-9fe9-af628494ea89 : rack is already in NonOperational status for reason NETWORK_UNREACHABLE. SetNonOperationalVds command is skipped. >2014-08-25 14:31:02,436 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:32:12,004 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-47) [1131825a] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:32:12,006 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1131825a] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 70f1798e >2014-08-25 14:32:12,010 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-47) [1131825a] FINISH, SetVdsStatusVDSCommand, log id: 70f1798e >2014-08-25 14:32:12,032 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-47) [1131825a] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:32:12,037 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [1131825a] Correlation ID: 1131825a, Job ID: ec26650d-3901-4730-8ba9-cc9e107d12bb, Call Stack: null, Custom Event ID: -1, Message: Host rack was switched to Maintenance mode by admin. >2014-08-25 14:32:13,334 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) [7c5190b2] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = fd905932-df0d-4553-9fe9-af628494ea89 : rack >2014-08-25 14:32:13,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-44) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: rack. >2014-08-25 14:32:26,794 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (ajp-/127.0.0.1:8702-8) [65876385] Running command: SetupNetworksCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:32:26,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] START, SetupNetworksVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[rhevm {id=3aafa482-acbe-485b-b5f0-f8104d167804, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=e25cb031-2c3f-4070-a0e9-55237c7921ef, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null, qosId=null}], > bonds=[], > interfaces=[em1 {id=b042751c-a431-4521-8cbf-c05d1836d05c, vdsId=fd905932-df0d-4553-9fe9-af628494ea89, name=em1, macAddress=d4:ae:52:c7:0d:8b, networkName=rhevm, bondName=null, bootProtocol=DHCP, address=null, subnet=null, gateway=null, mtu=0, bridged=true, speed=1000, type=2, networkImplementationDetails=null}, > em2 {id=22868b7b-4484-4b39-bd39-3784368abd57, vdsId=fd905932-df0d-4553-9fe9-af628494ea89, name=em2, macAddress=d4:ae:52:c7:0d:8c, networkName=null, bondName=null, bootProtocol=DHCP, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}], > removedNetworks=[ovirtmgmt], > removedBonds=[]), log id: 38b6b7fb >2014-08-25 14:32:26,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] FINISH, SetupNetworksVDSCommand, log id: 38b6b7fb >2014-08-25 14:32:26,809 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:32:30,364 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-08-25 14:32:30,364 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-08-25 14:32:33,219 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) [370dda9a] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from Up --> RebootInProgress >2014-08-25 14:32:33,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-88) [370dda9a] START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 7ace6c16 >2014-08-25 14:32:33,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-88) [370dda9a] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=12911, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@2b5c13e2, vmName=jebatrhevh, cpuType=Westmere}], log id: 7ace6c16 >2014-08-25 14:32:33,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-08-25 14:32:33,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-08-25 14:32:36,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-08-25 14:32:36,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-08-25 14:32:39,369 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Command PollVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89) execution failed. Exception: VDSNetworkException: VDSGenericException: VDSNetworkException: Timeout during xml-rpc call >2014-08-25 14:32:39,369 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (ajp-/127.0.0.1:8702-8) [65876385] Timeout waiting for VDSM response. java.util.concurrent.TimeoutException >2014-08-25 14:32:47,252 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [29aedf41] Lock Acquired to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:32:47,271 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Running command: ActivateVdsCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:32:47,271 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Before acquiring lock in order to prevent monitoring for host rack from data-center datacenter_None >2014-08-25 14:32:47,271 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Lock acquired, from now a monitoring of host will be skipped for host rack from data-center datacenter_None >2014-08-25 14:32:47,281 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 27e9f4e6 >2014-08-25 14:32:47,285 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] FINISH, SetVdsStatusVDSCommand, log id: 27e9f4e6 >2014-08-25 14:32:47,320 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Activate finished. Lock released. Monitoring can run now for host rack from data-center datacenter_None >2014-08-25 14:32:47,341 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Correlation ID: 29aedf41, Job ID: 4fa3cb59-a6ee-431f-84bc-d4a90b8809c0, Call Stack: null, Custom Event ID: -1, Message: Host rack was activated by admin. >2014-08-25 14:32:47,345 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [29aedf41] Lock freed to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:32:49,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89]), log id: 60653b71 >2014-08-25 14:32:49,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-53) [5ff2a2bc] FINISH, GetHardwareInfoVDSCommand, log id: 60653b71 >2014-08-25 14:32:49,487 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-53) [56c95309] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:32:49,505 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [56c95309] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host rack. >2014-08-25 14:32:49,549 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-53) [1f134723] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-08-25 14:32:49,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [1f134723] START, SetMOMPolicyParametersVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 731e293c >2014-08-25 14:32:49,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-53) [1f134723] FINISH, SetMOMPolicyParametersVDSCommand, log id: 731e293c >2014-08-25 14:32:49,651 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) [1f134723] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-08-25 14:32:49,658 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-53) [2a24b06f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:24,807 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) [4fb9b4d0] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from RebootInProgress --> Up >2014-08-25 14:33:30,419 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-41) [5dacf3cf] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:30,422 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5dacf3cf] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 46f627fb >2014-08-25 14:33:30,425 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-41) [5dacf3cf] FINISH, SetVdsStatusVDSCommand, log id: 46f627fb >2014-08-25 14:33:30,444 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-41) [5dacf3cf] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:30,452 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-41) [5dacf3cf] Correlation ID: 5dacf3cf, Job ID: 23196a54-680a-43af-8c85-d9e29766c4a7, Call Stack: null, Custom Event ID: -1, Message: Host rack was switched to Maintenance mode by admin. >2014-08-25 14:33:32,111 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-12) [4661b39f] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = fd905932-df0d-4553-9fe9-af628494ea89 : rack >2014-08-25 14:33:32,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-49) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: rack. >2014-08-25 14:33:44,875 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS, ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 14:33:44,880 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] START, RemoveVdsVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 59bb4d5c >2014-08-25 14:33:44,880 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [2a777e87] vdsManager::disposing >2014-08-25 14:33:44,880 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] FINISH, RemoveVdsVDSCommand, log id: 59bb4d5c >2014-08-25 14:33:44,882 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] START, AddVdsVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 338ecb88 >2014-08-25 14:33:44,882 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] AddVds - entered , starting logic to add VDS fd905932-df0d-4553-9fe9-af628494ea89 >2014-08-25 14:33:44,883 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] AddVds - VDS fd905932-df0d-4553-9fe9-af628494ea89 was added, will try to add it to the resource manager >2014-08-25 14:33:44,883 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [2a777e87] Entered VdsManager constructor >2014-08-25 14:33:44,897 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-1) [2a777e87] Initialize vdsBroker (10.34.62.208,54,321) >2014-08-25 14:33:44,897 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-1) [2a777e87] VDS fd905932-df0d-4553-9fe9-af628494ea89 was added to the Resource Manager >2014-08-25 14:33:44,897 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-1) [2a777e87] FINISH, AddVdsVDSCommand, log id: 338ecb88 >2014-08-25 14:33:44,902 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [56c51fbc] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:44,907 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-1) [56c51fbc] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-08-25 14:33:44,938 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) [56c51fbc] Correlation ID: 2a777e87, Call Stack: null, Custom Event ID: -1, Message: Host rack configuration was updated by admin. >2014-08-25 14:33:44,943 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [2c25bd24] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:44,963 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [2c25bd24] Running command: SetupNetworksCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:44,964 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [2c25bd24] No changes were detected in setup networks for host rack (ID: fd905932-df0d-4553-9fe9-af628494ea89) >2014-08-25 14:33:45,096 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 14:33:45,096 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 14:33:45,096 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-3) [535b0f8c] Running command: UpdateVdsCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:45,103 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 14:33:45,103 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-08-25 14:33:45,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [535b0f8c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-08-25 14:33:45,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [535b0f8c] Correlation ID: 535b0f8c, Call Stack: null, Custom Event ID: -1, Message: Host rack configuration was updated by admin. >2014-08-25 14:33:47,695 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-4) [457b4945] Lock Acquired to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:33:47,716 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] Running command: ActivateVdsCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:47,716 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] Before acquiring lock in order to prevent monitoring for host rack from data-center Default >2014-08-25 14:33:47,716 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] Lock acquired, from now a monitoring of host will be skipped for host rack from data-center Default >2014-08-25 14:33:47,733 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 631fdf3a >2014-08-25 14:33:47,737 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] FINISH, SetVdsStatusVDSCommand, log id: 631fdf3a >2014-08-25 14:33:47,750 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] Activate finished. Lock released. Monitoring can run now for host rack from data-center Default >2014-08-25 14:33:47,755 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [457b4945] Correlation ID: 457b4945, Job ID: 269c300e-02e3-42e2-b3df-f91ea7647730, Call Stack: null, Custom Event ID: -1, Message: Host rack was activated by admin. >2014-08-25 14:33:47,759 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [457b4945] Lock freed to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:33:47,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89]), log id: 7d89854d >2014-08-25 14:33:48,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-84) [330a5600] FINISH, GetHardwareInfoVDSCommand, log id: 7d89854d >2014-08-25 14:33:48,046 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-84) [3e4c4692] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:33:48,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-84) [3e4c4692] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89]), log id: 7957d31e >2014-08-25 14:33:48,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-84) [3e4c4692] FINISH, GetHardwareInfoVDSCommand, log id: 7957d31e >2014-08-25 14:33:48,158 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) [3e4c4692] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host rack. >2014-08-25 14:33:48,202 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-84) [5e41b8c9] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 14:33:48,208 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 14:33:48,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] START, ConnectStorageServerVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 40d3ac39 >2014-08-25 14:33:53,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] FINISH, ConnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 40d3ac39 >2014-08-25 14:33:53,560 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] Host rack storage connection was succeeded >2014-08-25 14:33:53,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, ConnectStoragePoolVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 2, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: 3c8bbe0 >2014-08-25 14:33:54,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, ConnectStoragePoolVDSCommand, log id: 3c8bbe0 >2014-08-25 14:33:54,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] START, SetMOMPolicyParametersVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 2778d0d9 >2014-08-25 14:33:54,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-84) [88599a0] FINISH, SetMOMPolicyParametersVDSCommand, log id: 2778d0d9 >2014-08-25 14:33:54,735 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) [88599a0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-08-25 14:33:54,741 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-84) [88599a0] Initializing Host: rack >2014-08-25 14:33:54,745 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-84) [6e5aed7f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:34:13,000 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (org.ovirt.thread.pool-4-thread-48) [2eb77df6] Running command: CommitNetworkChangesCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:34:13,003 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-4-thread-48) [2eb77df6] START, SetSafeNetworkConfigVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 4e70691c >2014-08-25 14:34:13,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (org.ovirt.thread.pool-4-thread-48) [2eb77df6] FINISH, SetSafeNetworkConfigVDSCommand, log id: 4e70691c >2014-08-25 14:34:13,056 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [2eb77df6] Correlation ID: 2eb77df6, Job ID: 632d073d-09e1-4400-b188-2a33fbc0c0bd, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host rack >2014-08-25 14:34:24,536 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-3) [564fe266] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:34:24,630 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] Running command: MigrateVmCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:34:24,671 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] START, MigrateVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=slot-7.rhev.lab.eng.brq.redhat.com, dstVdsId=fd905932-df0d-4553-9fe9-af628494ea89, dstHost=10.34.62.208:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3eb1ddab >2014-08-25 14:34:24,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] VdsBroker::migrate::Entered (vm_guid=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=slot-7.rhev.lab.eng.brq.redhat.com, dstHost=10.34.62.208:54321, method=online >2014-08-25 14:34:24,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] START, MigrateBrokerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=slot-7.rhev.lab.eng.brq.redhat.com, dstVdsId=fd905932-df0d-4553-9fe9-af628494ea89, dstHost=10.34.62.208:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 5124bba9 >2014-08-25 14:34:24,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] FINISH, MigrateBrokerVDSCommand, log id: 5124bba9 >2014-08-25 14:34:24,703 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-36) [564fe266] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 3eb1ddab >2014-08-25 14:34:24,726 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-36) [564fe266] Correlation ID: 564fe266, Job ID: 88ffc75a-71d3-4c5c-a636-6f2a05edeca6, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: jebatrhevh, Source: slot-7.rhev.lab.eng.brq.redhat.com, Destination: rack, User: admin). >2014-08-25 14:34:24,970 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:28,002 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-50) [ce653cf] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:31,023 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-16) [74ef103e] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:34,042 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) [7279bcb0] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:37,063 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) [5c70390e] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:40,095 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) [3d89d729] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:43,127 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) [1134222b] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:46,145 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) [5707fcbd] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:49,164 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [2ce12797] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:52,182 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) [3a934e6f] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:55,217 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-72) [603aa602] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds rack ignoring it in the refresh until migration is done >2014-08-25 14:34:58,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] START, FullListVdsCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 3f25a31b >2014-08-25 14:34:58,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, vmType=kvm, emulatedMachine=rhel6.5.0, status=Up, memGuaranteedSize=1024, display=qxl, pid=2241, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@3ff76200, vmName=jebatrhevh, cpuType=Westmere}], log id: 3f25a31b >2014-08-25 14:34:58,273 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-63) [2e387c92] Received a spice Device without an address when processing VM 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=0}, device=spice, tlsPort=5901, type=graphics} >2014-08-25 14:34:58,302 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) [2e387c92] Correlation ID: 564fe266, Job ID: 88ffc75a-71d3-4c5c-a636-6f2a05edeca6, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: jebatrhevh, Source: slot-7.rhev.lab.eng.brq.redhat.com, Destination: rack, Duration: 33 sec). >2014-08-25 14:34:58,305 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-63) [2e387c92] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:34:58,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-85) [b9368e7] START, DestroyVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, force=false, secondsToWait=0, gracefully=false), log id: 7182c5f5 >2014-08-25 14:34:59,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-85) [b9368e7] FINISH, DestroyVDSCommand, log id: 7182c5f5 >2014-08-25 14:34:59,190 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-85) [b9368e7] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 status = Down on vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:07,872 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-8) [3eabfb3e] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:35:07,957 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] Running command: MigrateVmCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:35:07,983 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] START, MigrateVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=10.34.62.208, dstVdsId=db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, dstHost=slot-7.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 22859c75 >2014-08-25 14:35:07,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] VdsBroker::migrate::Entered (vm_guid=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=10.34.62.208, dstHost=slot-7.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-08-25 14:35:07,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] START, MigrateBrokerVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, srcHost=10.34.62.208, dstVdsId=db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, dstHost=slot-7.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3deaf0e6 >2014-08-25 14:35:07,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] FINISH, MigrateBrokerVDSCommand, log id: 3deaf0e6 >2014-08-25 14:35:07,997 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 22859c75 >2014-08-25 14:35:08,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-49) [3eabfb3e] Correlation ID: 3eabfb3e, Job ID: 73d8df89-b0ee-4056-b6cf-fb2eea788e4a, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: jebatrhevh, Source: rack, Destination: slot-7.rhev.lab.eng.brq.redhat.com, User: admin). >2014-08-25 14:35:14,384 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) [7279bcb0] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:17,413 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-49) [564f5285] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:20,488 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) [3d89d729] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:23,520 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-1) [34ba8ae0] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:26,540 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) [5707fcbd] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:29,562 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-70) [2ce12797] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:32,584 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) [2a24b06f] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:35,623 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) [7fdf45ad] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:38,654 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-39) [138d4542] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:41,679 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-57) [67b760c4] RefreshVmList vm id 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 is migrating to vds slot-7.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-08-25 14:35:43,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-51) [38962e90] START, DestroyVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, force=false, secondsToWait=0, gracefully=false), log id: 7f761827 >2014-08-25 14:35:43,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-51) [38962e90] FINISH, DestroyVDSCommand, log id: 7f761827 >2014-08-25 14:35:43,782 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-51) [38962e90] Handing over VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 to Host db0a9d36-feed-4855-9ea1-cfa0ccc52b0f. Setting VM to status MigratingTo >2014-08-25 14:35:43,785 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-51) [38962e90] VM jebatrhevh (934ffff5-6fcd-4a73-86d6-6ae8e7265ea3) is running in db and not running in VDS rack >2014-08-25 14:35:43,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-51) [38962e90] START, FullListVdsCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, vds=Host[rack,fd905932-df0d-4553-9fe9-af628494ea89], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 7b134a7 >2014-08-25 14:35:43,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-51) [38962e90] FINISH, FullListVdsCommand, return: [], log id: 7b134a7 >2014-08-25 14:35:44,705 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) [5df48dff] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from MigratingTo --> Up >2014-08-25 14:35:44,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 7d739870 >2014-08-25 14:35:44,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=14259, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@301d2168, vmName=jebatrhevh, cpuType=Westmere}], log id: 7d739870 >2014-08-25 14:35:44,719 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) [5df48dff] Received a spice Device without an address when processing VM 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=0}, device=spice, tlsPort=5901, type=graphics} >2014-08-25 14:35:44,748 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) [5df48dff] Correlation ID: 3eabfb3e, Job ID: 73d8df89-b0ee-4056-b6cf-fb2eea788e4a, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: jebatrhevh, Source: rack, Destination: slot-7.rhev.lab.eng.brq.redhat.com, Duration: 36 sec). >2014-08-25 14:35:44,751 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (DefaultQuartzScheduler_Worker-3) [5df48dff] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 14:35:44,751 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:36:26,338 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-6) [1861a51a] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:36:26,340 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1861a51a] START, SetVdsStatusVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 5f8cac4d >2014-08-25 14:36:26,343 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-6) [1861a51a] FINISH, SetVdsStatusVDSCommand, log id: 5f8cac4d >2014-08-25 14:36:26,405 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-6) [1861a51a] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:36:26,410 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-6) [1861a51a] Correlation ID: 1861a51a, Job ID: 74f0a152-0493-4acc-a179-0ecb8c63cf17, Call Stack: null, Custom Event ID: -1, Message: Host rack was switched to Maintenance mode by admin. >2014-08-25 14:36:29,280 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) [245c458f] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = fd905932-df0d-4553-9fe9-af628494ea89 : rack >2014-08-25 14:36:29,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-2) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: rack. >2014-08-25 14:36:29,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-30) [245c458f] START, DisconnectStoragePoolVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 2), log id: 1b020c01 >2014-08-25 14:36:32,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-30) [245c458f] FINISH, DisconnectStoragePoolVDSCommand, log id: 1b020c01 >2014-08-25 14:36:32,244 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-30) [50d04c2] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 14:36:32,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-30) [50d04c2] START, DisconnectStorageServerVDSCommand(HostName = rack, HostId = fd905932-df0d-4553-9fe9-af628494ea89, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 43d6eadf >2014-08-25 14:36:32,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-30) [50d04c2] FINISH, DisconnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 43d6eadf >2014-08-25 14:36:53,987 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [2603e4b0] Lock Acquired to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:36:53,995 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] Running command: RemoveVdsCommand internal: false. Entities affected : ID: fd905932-df0d-4553-9fe9-af628494ea89 Type: VDS >2014-08-25 14:36:54,011 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] START, RemoveVdsVDSCommand( HostId = fd905932-df0d-4553-9fe9-af628494ea89), log id: 7e7d2f7e >2014-08-25 14:36:54,011 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] vdsManager::disposing >2014-08-25 14:36:54,011 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] FINISH, RemoveVdsVDSCommand, log id: 7e7d2f7e >2014-08-25 14:36:54,014 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] Correlation ID: 2603e4b0, Call Stack: null, Custom Event ID: -1, Message: Host rack was removed by admin. >2014-08-25 14:36:54,015 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-31) [2603e4b0] Lock freed to object EngineLock [exclusiveLocks= key: fd905932-df0d-4553-9fe9-af628494ea89 value: VDS >, sharedLocks= ] >2014-08-25 14:38:52,567 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:39:47,964 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-4-thread-15) [45774a96] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 14:39:47,980 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [730f9e00] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:39:47,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [730f9e00] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 132d38e0 >2014-08-25 14:39:48,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [730f9e00] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 132d38e0 >2014-08-25 14:39:48,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-15) [45774a96] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563), log id: 1cae2dfc >2014-08-25 14:40:09,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-15) [45774a96] FINISH, AttachStorageDomainVDSCommand, log id: 1cae2dfc >2014-08-25 14:40:09,564 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] Lock Acquired to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 14:40:09,583 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 14:40:09,588 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] Lock freed to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 14:40:09,589 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] ActivateStorage Domain. Before Connect all hosts to pool. Time:8/25/14 2:40 PM >2014-08-25 14:40:09,592 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [2ce6a88e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 14:40:09,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2ce6a88e] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 42b91453 >2014-08-25 14:40:09,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [2ce6a88e] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 42b91453 >2014-08-25 14:40:09,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563), log id: 17a9a427 >2014-08-25 14:40:10,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] FINISH, ActivateStorageDomainVDSCommand, log id: 17a9a427 >2014-08-25 14:40:10,087 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] ActivateStorage Domain. After Connect all hosts to pool. Time:8/25/14 2:40 PM >2014-08-25 14:40:10,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) [32f66e83] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 72098f54 >2014-08-25 14:40:10,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-1) [32f66e83] FINISH, RefreshStoragePoolVDSCommand, log id: 72098f54 >2014-08-25 14:40:10,157 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-1) [32f66e83] Refreshed vds slot-7.rhev.lab.eng.brq.redhat.com in pool Default >2014-08-25 14:40:10,161 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-15) [32f66e83] ActivateStorage Domain. After change storage pool status in vds. Time:8/25/14 2:40 PM >2014-08-25 14:40:10,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-50) [32f66e83] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 60cf5a6b >2014-08-25 14:40:10,169 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [32f66e83] Correlation ID: 32f66e83, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso (Data Center Default) was activated by admin >2014-08-25 14:40:10,178 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-15) [32f66e83] Correlation ID: 45774a96, Job ID: 6f0c5a26-9f45-4fff-add2-54e3be8e03c3, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso was attached to Data Center Default by admin >2014-08-25 14:40:10,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-50) [32f66e83] FINISH, GetFileStatsVDSCommand, return: {test.iso={status=0, ctime=1403622272.03, size=4}}, log id: 60cf5a6b >2014-08-25 14:40:10,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-50) [32f66e83] START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 535decaf >2014-08-25 14:40:10,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (org.ovirt.thread.pool-4-thread-50) [32f66e83] FINISH, GetFileStatsVDSCommand, return: {}, log id: 535decaf >2014-08-25 14:40:19,832 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) [6ca0350a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Warning, Low disk space.iso domain has 5 GB of free space >2014-08-25 14:40:22,864 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Attempting to update VMs/Templates Ovf. >2014-08-25 14:40:22,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Attempting to update VM OVFs in Data Center Default >2014-08-25 14:40:23,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 4dd6ccb4 >2014-08-25 14:40:23,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] FINISH, UpdateVMVDSCommand, log id: 4dd6ccb4 >2014-08-25 14:40:23,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Successfully updated VM OVFs in Data Center Default >2014-08-25 14:40:23,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Attempting to update template OVFs in Data Center Default >2014-08-25 14:40:23,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Successfully updated templates OVFs in Data Center Default >2014-08-25 14:40:23,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Attempting to remove unneeded template/vm OVFs in Data Center Default >2014-08-25 14:40:23,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) [1a51a4c3] Successfully removed unneeded template/vm OVFs in Data Center Default >2014-08-25 14:40:23,376 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:47:57,516 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 14:52:28,332 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [52216e60] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:52:28,357 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) [52216e60] Running command: AddDiskCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM, ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:52:28,502 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [3c54b7a2] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:52:28,513 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-5) [3c54b7a2] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:52:28,513 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c54b7a2] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca, imageSizeInBytes = 6442450944, volumeFormat = RAW, newImageId = f5a4d4a4-f071-4a1f-be99-a9d9225f0a17, newImageDescription = ), log id: 1ce8914e >2014-08-25 14:52:28,513 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c54b7a2] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 14:52:28,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-5) [3c54b7a2] FINISH, CreateImageVDSCommand, return: f5a4d4a4-f071-4a1f-be99-a9d9225f0a17, log id: 1ce8914e >2014-08-25 14:52:28,900 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [3c54b7a2] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 25c58284-1e19-4c18-943d-2809a0e7124c >2014-08-25 14:52:28,901 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [3c54b7a2] CommandMultiAsyncTasks::AttachTask: Attaching task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 to command 25c58284-1e19-4c18-943d-2809a0e7124c. >2014-08-25 14:52:28,910 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [3c54b7a2] Adding task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 14:52:28,931 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [3c54b7a2] Correlation ID: 52216e60, Job ID: 85b3fd03-8d77-4e8b-a868-8020fe2ae861, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of jebatrhevh_Disk2 was initiated on VM jebatrhevh by admin. >2014-08-25 14:52:28,931 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [3c54b7a2] BaseAsyncTask::startPollingTask: Starting to poll task 7d7046ee-4b7c-4201-a6d5-08875d6aa032. >2014-08-25 14:52:37,290 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-57) [67b760c4] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-25 14:52:37,299 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) [67b760c4] SPMAsyncTask::PollTask: Polling task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 14:52:37,304 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-57) [67b760c4] BaseAsyncTask::OnTaskEndSuccess: Task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 14:52:37,306 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-57) [67b760c4] CommandAsyncTask::EndActionIfNecessary: All tasks of command 25c58284-1e19-4c18-943d-2809a0e7124c has ended -> executing endAction >2014-08-25 14:52:37,306 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-57) [67b760c4] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 25c58284-1e19-4c18-943d-2809a0e7124c): calling endAction . >2014-08-25 14:52:37,307 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) [67b760c4] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-25 14:52:37,317 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-39) [52216e60] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-25 14:52:37,362 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-39) [3c54b7a2] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-25 14:52:37,373 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c54b7a2] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca, imageId = f5a4d4a4-f071-4a1f-be99-a9d9225f0a17), log id: 69c8b964 >2014-08-25 14:52:37,402 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c54b7a2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@5d366d28, log id: 69c8b964 >2014-08-25 14:52:37,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) Correlation ID: 52216e60, Job ID: 85b3fd03-8d77-4e8b-a868-8020fe2ae861, Call Stack: null, Custom Event ID: -1, Message: The disk jebatrhevh_Disk2 was successfully added to VM jebatrhevh. >2014-08-25 14:52:37,419 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-25 14:52:37,419 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-25 14:52:37,423 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-39) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 >2014-08-25 14:52:37,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 7d7046ee-4b7c-4201-a6d5-08875d6aa032), log id: 305e9b41 >2014-08-25 14:52:37,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=7d7046ee-4b7c-4201-a6d5-08875d6aa032), log id: 1322e136 >2014-08-25 14:52:37,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) FINISH, HSMClearTaskVDSCommand, log id: 1322e136 >2014-08-25 14:52:37,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) FINISH, SPMClearTaskVDSCommand, log id: 305e9b41 >2014-08-25 14:52:37,470 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-39) BaseAsyncTask::RemoveTaskFromDB: Removed task 7d7046ee-4b7c-4201-a6d5-08875d6aa032 from DataBase >2014-08-25 14:52:37,470 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 25c58284-1e19-4c18-943d-2809a0e7124c >2014-08-25 14:52:50,919 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-6) [71d88514] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:52:50,942 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-6) [71d88514] Running command: AddDiskCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM, ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:52:51,007 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-6) [42106b8] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 14:52:51,022 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-6) [42106b8] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:52:51,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [42106b8] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageSizeInBytes = 2147483648, volumeFormat = RAW, newImageId = 09ce4838-ca47-412a-ad87-c87ed3432ecd, newImageDescription = ), log id: f7cdec0 >2014-08-25 14:52:51,024 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [42106b8] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 14:52:51,891 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [42106b8] FINISH, CreateImageVDSCommand, return: 09ce4838-ca47-412a-ad87-c87ed3432ecd, log id: f7cdec0 >2014-08-25 14:52:51,903 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-6) [42106b8] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 817b09b7-c166-40d3-88f8-4ae592da1311 >2014-08-25 14:52:51,903 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-6) [42106b8] CommandMultiAsyncTasks::AttachTask: Attaching task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 to command 817b09b7-c166-40d3-88f8-4ae592da1311. >2014-08-25 14:52:51,915 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-6) [42106b8] Adding task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 14:52:51,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [42106b8] Correlation ID: 71d88514, Job ID: 99501b6c-a5cc-4f73-b686-a7a2946dacff, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of jebatrhevh_Disk3 was initiated on VM jebatrhevh by admin. >2014-08-25 14:52:51,937 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-6) [42106b8] BaseAsyncTask::startPollingTask: Starting to poll task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9. >2014-08-25 14:52:57,308 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now >2014-08-25 14:52:57,487 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] SPMAsyncTask::PollTask: Polling task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-25 14:52:57,487 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 14:53:46,116 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-26) [450d153] Setting new tasks map. The map contains now 1 tasks >2014-08-25 14:53:48,034 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-41) [92a152] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-25 14:53:48,116 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-41) [92a152] Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 14:55:18,975 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] SPMAsyncTask::PollTask: Polling task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 14:55:18,991 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] BaseAsyncTask::OnTaskEndSuccess: Task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 14:55:18,992 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] CommandAsyncTask::EndActionIfNecessary: All tasks of command 817b09b7-c166-40d3-88f8-4ae592da1311 has ended -> executing endAction >2014-08-25 14:55:18,992 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 817b09b7-c166-40d3-88f8-4ae592da1311): calling endAction . >2014-08-25 14:55:18,993 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-40) [450d153] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-25 14:55:19,004 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-40) [71d88514] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-25 14:55:19,058 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-40) [6c1c606c] Lock Acquired to object EngineLock [exclusiveLocks= key: 101daa5c-71ae-43be-9c60-688659531a3c value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:55:19,157 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-40) [6c1c606c] Running command: HotPlugDiskToVmCommand internal: true. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:55:19,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-4-thread-40) [6c1c606c] START, HotPlugDiskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, diskId = 101daa5c-71ae-43be-9c60-688659531a3c), log id: 4c1183b6 >2014-08-25 14:55:19,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-4-thread-40) [6c1c606c] FINISH, HotPlugDiskVDSCommand, log id: 4c1183b6 >2014-08-25 14:55:19,625 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-40) [6c1c606c] Lock freed to object EngineLock [exclusiveLocks= key: 101daa5c-71ae-43be-9c60-688659531a3c value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 14:55:19,627 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-40) [42106b8] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-25 14:55:19,639 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-40) [42106b8] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageId = 09ce4838-ca47-412a-ad87-c87ed3432ecd), log id: 63a3152d >2014-08-25 14:55:19,683 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-40) [42106b8] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@fe7db8c1, log id: 63a3152d >2014-08-25 14:55:19,715 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) Correlation ID: 71d88514, Job ID: 99501b6c-a5cc-4f73-b686-a7a2946dacff, Call Stack: null, Custom Event ID: -1, Message: The disk jebatrhevh_Disk3 was successfully added to VM jebatrhevh. >2014-08-25 14:55:19,715 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-25 14:55:19,715 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-25 14:55:19,718 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-40) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 >2014-08-25 14:55:19,718 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-40) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 0b259b23-248d-4e3b-b86e-53e5fc4d82b9), log id: 136bb178 >2014-08-25 14:55:19,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-40) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=0b259b23-248d-4e3b-b86e-53e5fc4d82b9), log id: b753925 >2014-08-25 14:55:19,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-40) FINISH, HSMClearTaskVDSCommand, log id: b753925 >2014-08-25 14:55:19,756 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-40) FINISH, SPMClearTaskVDSCommand, log id: 136bb178 >2014-08-25 14:55:19,759 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-40) BaseAsyncTask::RemoveTaskFromDB: Removed task 0b259b23-248d-4e3b-b86e-53e5fc4d82b9 from DataBase >2014-08-25 14:55:19,759 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-40) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 817b09b7-c166-40d3-88f8-4ae592da1311 >2014-08-25 14:55:31,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) [2a24b06f] START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 252512b7 >2014-08-25 14:55:31,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-53) [2a24b06f] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=14259, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@24efbf6e, vmName=jebatrhevh, cpuType=Westmere}], log id: 252512b7 >2014-08-25 14:55:31,345 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) [2a24b06f] Received a spice Device without an address when processing VM 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 devices, skipping device: {port=5900, specParams={spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, keyMap=en-us, displayIp=0}, device=spice, tlsPort=5901, type=graphics} >2014-08-25 14:56:46,117 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) [4341adbf] Setting new tasks map. The map contains now 0 tasks >2014-08-25 14:56:46,117 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-46) [4341adbf] Cleared all tasks of pool 00000002-0002-0002-0002-000000000135. >2014-08-25 14:59:04,873 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-08-25 14:59:04,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-25 14:59:10,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 4ba20a18 >2014-08-25 14:59:10,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetFileStatsVDSCommand, return: {test.iso={status=0, ctime=1403622272.03, size=4}, qwerty.iso={status=0, ctime=1408971549.67, size=49530880}}, log id: 4ba20a18 >2014-08-25 14:59:10,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 86cd426 >2014-08-25 14:59:10,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetFileStatsVDSCommand, return: {}, log id: 86cd426 >2014-08-25 14:59:10,579 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): iso (All file type) >2014-08-25 14:59:25,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 4e7b362b >2014-08-25 14:59:25,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetFileStatsVDSCommand, return: {test.iso={status=0, ctime=1403622272.03, size=4}, qwerty.iso={status=0, ctime=1408971549.67, size=49530880}}, log id: 4e7b362b >2014-08-25 14:59:25,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) START, GetFileStatsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 5206bf44 >2014-08-25 14:59:25,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetFileStatsVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GetFileStatsVDSCommand, return: {}, log id: 5206bf44 >2014-08-25 14:59:25,648 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Refresh image list succeeded for domain(s): iso (All file type) >2014-08-25 14:59:38,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-9) [17d9dc3c] START, IsoPrefixVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId=00000002-0002-0002-0002-000000000135), log id: 25ade62c >2014-08-25 14:59:38,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-9) [17d9dc3c] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/mnt/pb-rh34.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140521133616/608a06d8-ca89-454c-a822-21469c220563/images/11111111-1111-1111-1111-111111111111, log id: 25ade62c >2014-08-25 14:59:38,475 INFO [org.ovirt.engine.core.bll.ChangeDiskCommand] (ajp-/127.0.0.1:8702-9) [17d9dc3c] Running command: ChangeDiskCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 14:59:38,479 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (ajp-/127.0.0.1:8702-9) [17d9dc3c] START, ChangeDiskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, diskPath=/rhev/data-center/mnt/pb-rh34.rhev.lab.eng.brq.redhat.com:_var_lib_exports_iso-20140521133616/608a06d8-ca89-454c-a822-21469c220563/images/11111111-1111-1111-1111-111111111111/qwerty.iso), log id: 2968e8b8 >2014-08-25 14:59:38,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (ajp-/127.0.0.1:8702-9) [17d9dc3c] FINISH, ChangeDiskVDSCommand, return: Up, log id: 2968e8b8 >2014-08-25 14:59:38,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [17d9dc3c] Correlation ID: 17d9dc3c, Job ID: 909641ed-ece6-46d2-8134-0c9535f80aa4, Call Stack: null, Custom Event ID: -1, Message: CD qwerty.iso was inserted to VM jebatrhevh by admin >2014-08-25 15:00:49,672 INFO [org.ovirt.engine.core.bll.ChangeDiskCommand] (ajp-/127.0.0.1:8702-3) [5c15f0f0] Running command: ChangeDiskCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 15:00:49,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (ajp-/127.0.0.1:8702-3) [5c15f0f0] START, ChangeDiskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, diskPath=), log id: 623a6c6d >2014-08-25 15:00:49,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ChangeDiskVDSCommand] (ajp-/127.0.0.1:8702-3) [5c15f0f0] FINISH, ChangeDiskVDSCommand, return: Up, log id: 623a6c6d >2014-08-25 15:00:49,709 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5c15f0f0] Correlation ID: 5c15f0f0, Job ID: 2b5f4d69-f9b9-4831-8d16-dc293b30bfa9, Call Stack: null, Custom Event ID: -1, Message: CD was ejected from VM jebatrhevh by admin >2014-08-25 15:01:01,246 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-4) [2a3af102] Lock Acquired to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 15:01:01,318 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-29) [2a3af102] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 15:01:01,325 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-29) [2a3af102] START, DeactivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 3), log id: 48480c6c >2014-08-25 15:01:01,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-29) [2a3af102] FINISH, DeactivateStorageDomainVDSCommand, log id: 48480c6c >2014-08-25 15:01:01,495 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-29) [2a3af102] Lock freed to object EngineLock [exclusiveLocks= key: 608a06d8-ca89-454c-a822-21469c220563 value: STORAGE >, sharedLocks= ] >2014-08-25 15:01:01,497 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-3) [2a3af102] After deactivate treatment vds: slot-7.rhev.lab.eng.brq.redhat.com,pool Default >2014-08-25 15:01:01,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [2a3af102] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 3d30e72f >2014-08-25 15:01:01,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-3) [2a3af102] FINISH, RefreshStoragePoolVDSCommand, log id: 3d30e72f >2014-08-25 15:01:01,543 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-29) [624b14b0] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 15:01:01,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [624b14b0] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 52ceb1c2 >2014-08-25 15:01:01,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [624b14b0] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 52ceb1c2 >2014-08-25 15:01:01,821 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [624b14b0] Correlation ID: 2a3af102, Job ID: e67897f2-e62a-46a9-a623-3b33f1c0eff1, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso (Data Center Default) was deactivated by admin >2014-08-25 15:01:05,728 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Running command: DetachStorageDomainFromPoolCommand internal: false. Entities affected : ID: 608a06d8-ca89-454c-a822-21469c220563 Type: Storage >2014-08-25 15:01:05,728 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Start detach storage domain >2014-08-25 15:01:05,731 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Detach storage domain: before connect >2014-08-25 15:01:05,734 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-47) [74a6d75] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 15:01:05,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [74a6d75] START, ConnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 73519781 >2014-08-25 15:01:06,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-47) [74a6d75] FINISH, ConnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 73519781 >2014-08-25 15:01:06,082 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Detach storage domain: after connect >2014-08-25 15:01:06,082 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] START, DetachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 608a06d8-ca89-454c-a822-21469c220563, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 3, force = false), log id: 335ee5f >2014-08-25 15:01:27,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DetachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] FINISH, DetachStorageDomainVDSCommand, log id: 335ee5f >2014-08-25 15:01:27,507 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Detach storage domain: after detach in vds >2014-08-25 15:01:27,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4c43c646] START, RefreshStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 200ff26e >2014-08-25 15:01:27,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-38) [4c43c646] FINISH, RefreshStoragePoolVDSCommand, log id: 200ff26e >2014-08-25 15:01:27,583 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-38) [45827d0e] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-08-25 15:01:27,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [45827d0e] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 61fe5fc6-a2f0-457d-a2e8-42d4cd932183, connection: pb-rh34.rhev.lab.eng.brq.redhat.com:/var/lib/exports/iso-20140521133616, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 73058bfa >2014-08-25 15:01:27,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-38) [45827d0e] FINISH, DisconnectStorageServerVDSCommand, return: {61fe5fc6-a2f0-457d-a2e8-42d4cd932183=0}, log id: 73058bfa >2014-08-25 15:01:27,898 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Detach storage domain: after disconnect storage >2014-08-25 15:01:27,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] START, ResetISOPathVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 63a25718 >2014-08-25 15:01:27,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ResetISOPathVDSCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] FINISH, ResetISOPathVDSCommand, log id: 63a25718 >2014-08-25 15:01:27,903 INFO [org.ovirt.engine.core.bll.storage.DetachStorageDomainFromPoolCommand] (org.ovirt.thread.pool-4-thread-4) [4c43c646] End detach storage domain >2014-08-25 15:01:27,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-4) [4c43c646] Correlation ID: 4c43c646, Job ID: cc0566dd-6e22-4439-84ec-9021b9d31dbc, Call Stack: null, Custom Event ID: -1, Message: Storage Domain iso was detached from Data Center Default by admin >2014-08-25 15:03:05,344 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:03:50,720 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:10:05,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-32) [574e3432] START, DestroyVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, force=false, secondsToWait=0, gracefully=false), log id: 340dad0b >2014-08-25 15:10:05,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-32) [574e3432] FINISH, DestroyVDSCommand, log id: 340dad0b >2014-08-25 15:10:05,854 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-32) [574e3432] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh is down. Exit message: User shut down >2014-08-25 15:10:05,855 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-32) [574e3432] VM jebatrhevh (934ffff5-6fcd-4a73-86d6-6ae8e7265ea3) is running in db and not running in VDS slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 15:10:05,865 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-13) [5697f4f0] Running command: ProcessDownVmCommand internal: true. >2014-08-25 15:13:28,023 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (ajp-/127.0.0.1:8702-5) [2621c8ed] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:13:28,218 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-4-thread-26) Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 15:13:28,276 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-25 15:13:28,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] START, CreateSnapshotVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageSizeInBytes = 2147483648, volumeFormat = COW, newImageId = 892a1726-bc86-4550-8d10-6174710b8630, newImageDescription = , imageId = 09ce4838-ca47-412a-ad87-c87ed3432ecd, sourceImageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c), log id: 26453d46 >2014-08-25 15:13:28,290 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 15:13:28,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] FINISH, CreateSnapshotVDSCommand, return: 892a1726-bc86-4550-8d10-6174710b8630, log id: 26453d46 >2014-08-25 15:13:28,674 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command b76441b0-3e73-4fdf-9597-9298f7e4b05e >2014-08-25 15:13:28,674 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] CommandMultiAsyncTasks::AttachTask: Attaching task d7815363-99fb-487c-b00d-a06036bb6063 to command b76441b0-3e73-4fdf-9597-9298f7e4b05e. >2014-08-25 15:13:28,726 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-26) [2e8fcbcb] Adding task d7815363-99fb-487c-b00d-a06036bb6063 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:13:28,751 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-25 15:13:28,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] START, CreateSnapshotVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageSizeInBytes = 10737418240, volumeFormat = COW, newImageId = f04c864b-6698-4aa6-b855-ea9c1ba5b2d1, newImageDescription = , imageId = 9b809bd0-c89e-46c8-b088-82953fa434dc, sourceImageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9), log id: 42db7fb6 >2014-08-25 15:13:28,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 15:13:29,385 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] FINISH, CreateSnapshotVDSCommand, return: f04c864b-6698-4aa6-b855-ea9c1ba5b2d1, log id: 42db7fb6 >2014-08-25 15:13:29,436 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] CommandMultiAsyncTasks::AttachTask: Attaching task cd7e2074-eb0c-4136-ba8c-7111329d6c55 to command b76441b0-3e73-4fdf-9597-9298f7e4b05e. >2014-08-25 15:13:29,465 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-26) [7b3d358b] Adding task cd7e2074-eb0c-4136-ba8c-7111329d6c55 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:13:29,475 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-26) [10d4418c] Running command: CreateSnapshotCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-25 15:13:29,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [10d4418c] START, CreateSnapshotVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca, imageSizeInBytes = 6442450944, volumeFormat = COW, newImageId = 5e87da18-ec01-4bf6-a40a-e9108f630c41, newImageDescription = , imageId = f5a4d4a4-f071-4a1f-be99-a9d9225f0a17, sourceImageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca), log id: 7ff9a444 >2014-08-25 15:13:29,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [10d4418c] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 15:13:29,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-4-thread-26) [10d4418c] FINISH, CreateSnapshotVDSCommand, return: 5e87da18-ec01-4bf6-a40a-e9108f630c41, log id: 7ff9a444 >2014-08-25 15:13:29,958 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-4-thread-26) [10d4418c] CommandMultiAsyncTasks::AttachTask: Attaching task 99d55e61-f0c1-4298-b850-92fbaa58ab62 to command b76441b0-3e73-4fdf-9597-9298f7e4b05e. >2014-08-25 15:13:29,987 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-26) [10d4418c] Adding task 99d55e61-f0c1-4298-b850-92fbaa58ab62 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:13:30,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) Correlation ID: 2621c8ed, Job ID: d2773684-af4b-4792-ab5f-046fa7682008, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ffff' creation for VM 'jebatrhevh' was initiated by admin. >2014-08-25 15:13:30,125 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task d7815363-99fb-487c-b00d-a06036bb6063. >2014-08-25 15:13:30,125 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task cd7e2074-eb0c-4136-ba8c-7111329d6c55. >2014-08-25 15:13:30,125 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-26) BaseAsyncTask::startPollingTask: Starting to poll task 99d55e61-f0c1-4298-b850-92fbaa58ab62. >2014-08-25 15:13:39,049 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-5) [371f8ade] Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now >2014-08-25 15:13:39,087 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] SPMAsyncTask::PollTask: Polling task cd7e2074-eb0c-4136-ba8c-7111329d6c55 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:13:39,092 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] BaseAsyncTask::OnTaskEndSuccess: Task cd7e2074-eb0c-4136-ba8c-7111329d6c55 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:13:39,093 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [371f8ade] Task with DB Task ID dd3ea9cc-d609-4932-b376-f50c652cc567 and VDSM Task ID 99d55e61-f0c1-4298-b850-92fbaa58ab62 is in state Polling. End action for command b76441b0-3e73-4fdf-9597-9298f7e4b05e will proceed when all the entitys tasks are completed. >2014-08-25 15:13:39,093 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] SPMAsyncTask::PollTask: Polling task 99d55e61-f0c1-4298-b850-92fbaa58ab62 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:13:39,098 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] BaseAsyncTask::OnTaskEndSuccess: Task 99d55e61-f0c1-4298-b850-92fbaa58ab62 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:13:39,098 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-5) [371f8ade] Task with DB Task ID ac329300-a72d-49c4-93ef-36155d2b578b and VDSM Task ID d7815363-99fb-487c-b00d-a06036bb6063 is in state Polling. End action for command b76441b0-3e73-4fdf-9597-9298f7e4b05e will proceed when all the entitys tasks are completed. >2014-08-25 15:13:39,098 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] SPMAsyncTask::PollTask: Polling task d7815363-99fb-487c-b00d-a06036bb6063 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:13:39,104 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] BaseAsyncTask::OnTaskEndSuccess: Task d7815363-99fb-487c-b00d-a06036bb6063 (Parent Command CreateAllSnapshotsFromVm, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:13:39,104 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] CommandAsyncTask::EndActionIfNecessary: All tasks of command b76441b0-3e73-4fdf-9597-9298f7e4b05e has ended -> executing endAction >2014-08-25 15:13:39,104 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-5) [371f8ade] CommandAsyncTask::endAction: Ending action for 3 tasks (command ID: b76441b0-3e73-4fdf-9597-9298f7e4b05e): calling endAction . >2014-08-25 15:13:39,104 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-31) [371f8ade] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction CreateAllSnapshotsFromVm, executionIndex: 0 >2014-08-25 15:13:39,119 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-4-thread-31) [371f8ade] Ending command successfully: org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand >2014-08-25 15:13:39,130 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-31) [2e8fcbcb] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-25 15:13:39,134 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2e8fcbcb] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageId = 892a1726-bc86-4550-8d10-6174710b8630), log id: 3a12d64a >2014-08-25 15:13:39,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [2e8fcbcb] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@42647131, log id: 3a12d64a >2014-08-25 15:13:39,203 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-31) [7b3d358b] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-25 15:13:39,214 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [7b3d358b] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageId = f04c864b-6698-4aa6-b855-ea9c1ba5b2d1), log id: 7c2bc781 >2014-08-25 15:13:39,243 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [7b3d358b] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@744ad17, log id: 7c2bc781 >2014-08-25 15:13:39,254 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-4-thread-31) [10d4418c] Ending command successfully: org.ovirt.engine.core.bll.CreateSnapshotCommand >2014-08-25 15:13:39,263 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [10d4418c] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca, imageId = 5e87da18-ec01-4bf6-a40a-e9108f630c41), log id: 4224a635 >2014-08-25 15:13:39,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-31) [10d4418c] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@c78e2253, log id: 4224a635 >2014-08-25 15:13:39,300 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-4-thread-31) Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:13:39,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-31) Correlation ID: 2621c8ed, Job ID: d2773684-af4b-4792-ab5f-046fa7682008, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ffff' creation for VM 'jebatrhevh' has been completed. >2014-08-25 15:13:39,319 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-31) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm completed, handling the result. >2014-08-25 15:13:39,319 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-31) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type CreateAllSnapshotsFromVm succeeded, clearing tasks. >2014-08-25 15:13:39,323 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 99d55e61-f0c1-4298-b850-92fbaa58ab62 >2014-08-25 15:13:39,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 99d55e61-f0c1-4298-b850-92fbaa58ab62), log id: 15ca878e >2014-08-25 15:13:39,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=99d55e61-f0c1-4298-b850-92fbaa58ab62), log id: 238986cf >2014-08-25 15:13:39,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, HSMClearTaskVDSCommand, log id: 238986cf >2014-08-25 15:13:39,363 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, SPMClearTaskVDSCommand, log id: 15ca878e >2014-08-25 15:13:39,366 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) BaseAsyncTask::RemoveTaskFromDB: Removed task 99d55e61-f0c1-4298-b850-92fbaa58ab62 from DataBase >2014-08-25 15:13:39,366 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) SPMAsyncTask::ClearAsyncTask: Attempting to clear task cd7e2074-eb0c-4136-ba8c-7111329d6c55 >2014-08-25 15:13:39,367 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = cd7e2074-eb0c-4136-ba8c-7111329d6c55), log id: 42878e01 >2014-08-25 15:13:39,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=cd7e2074-eb0c-4136-ba8c-7111329d6c55), log id: 517c05c6 >2014-08-25 15:13:39,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, HSMClearTaskVDSCommand, log id: 517c05c6 >2014-08-25 15:13:39,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, SPMClearTaskVDSCommand, log id: 42878e01 >2014-08-25 15:13:39,444 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) BaseAsyncTask::RemoveTaskFromDB: Removed task cd7e2074-eb0c-4136-ba8c-7111329d6c55 from DataBase >2014-08-25 15:13:39,444 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) SPMAsyncTask::ClearAsyncTask: Attempting to clear task d7815363-99fb-487c-b00d-a06036bb6063 >2014-08-25 15:13:39,444 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = d7815363-99fb-487c-b00d-a06036bb6063), log id: 508c0d1c >2014-08-25 15:13:39,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=d7815363-99fb-487c-b00d-a06036bb6063), log id: 1ab0d294 >2014-08-25 15:13:39,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, HSMClearTaskVDSCommand, log id: 1ab0d294 >2014-08-25 15:13:39,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-31) FINISH, SPMClearTaskVDSCommand, log id: 508c0d1c >2014-08-25 15:13:39,521 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-31) BaseAsyncTask::RemoveTaskFromDB: Removed task d7815363-99fb-487c-b00d-a06036bb6063 from DataBase >2014-08-25 15:13:39,521 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-31) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity b76441b0-3e73-4fdf-9597-9298f7e4b05e >2014-08-25 15:13:49,402 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (ajp-/127.0.0.1:8702-3) [59e6c484] Lock Acquired to object EngineLock [exclusiveLocks= key: 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 15:13:49,429 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-39) [59e6c484] Running command: RemoveDiskCommand internal: false. Entities affected : ID: 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca Type: Disk >2014-08-25 15:13:49,443 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-4-thread-39) [3176465c] Running command: RemoveImageCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 15:13:49,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3176465c] START, DeleteImageGroupVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca, postZeros = false, forceDelete = false), log id: 29ba550f >2014-08-25 15:13:49,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3176465c] FINISH, DeleteImageGroupVDSCommand, log id: 29ba550f >2014-08-25 15:13:49,969 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) [3176465c] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 43ae438f-193c-4260-aade-2a05f8beaef0 >2014-08-25 15:13:49,969 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-4-thread-39) [3176465c] CommandMultiAsyncTasks::AttachTask: Attaching task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 to command 43ae438f-193c-4260-aade-2a05f8beaef0. >2014-08-25 15:13:49,990 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-39) [3176465c] Adding task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:13:51,286 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) [3176465c] Correlation ID: 59e6c484, Job ID: 43a12b4b-4947-48e6-9d75-98c560b27666, Call Stack: null, Custom Event ID: -1, Message: Disk jebatrhevh_Disk2 was successfully removed from domain n2 (User admin. >2014-08-25 15:13:51,286 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-39) [3176465c] BaseAsyncTask::startPollingTask: Starting to poll task 3796b8d1-a25e-4552-b0d8-3fd4f7660811. >2014-08-25 15:13:51,286 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-39) [3176465c] Lock freed to object EngineLock [exclusiveLocks= key: 77a1f3c3-6fe1-4e21-9bb5-e595edaa53ca value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 15:13:59,106 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-26) [450d153] Polling and updating Async Tasks: 4 tasks, 1 tasks to poll now >2014-08-25 15:13:59,116 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] SPMAsyncTask::PollTask: Polling task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:13:59,121 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] BaseAsyncTask::OnTaskEndSuccess: Task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:13:59,121 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] CommandAsyncTask::EndActionIfNecessary: All tasks of command 43ae438f-193c-4260-aade-2a05f8beaef0 has ended -> executing endAction >2014-08-25 15:13:59,122 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-26) [450d153] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 43ae438f-193c-4260-aade-2a05f8beaef0): calling endAction . >2014-08-25 15:13:59,122 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-17) [450d153] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction RemoveDisk, executionIndex: 0 >2014-08-25 15:13:59,130 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-17) [450d153] Ending command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand >2014-08-25 15:13:59,130 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveDisk completed, handling the result. >2014-08-25 15:13:59,130 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveDisk succeeded, clearing tasks. >2014-08-25 15:13:59,133 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-17) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 >2014-08-25 15:13:59,133 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 3796b8d1-a25e-4552-b0d8-3fd4f7660811), log id: 30569af9 >2014-08-25 15:13:59,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=3796b8d1-a25e-4552-b0d8-3fd4f7660811), log id: 5d86a3a >2014-08-25 15:13:59,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, HSMClearTaskVDSCommand, log id: 5d86a3a >2014-08-25 15:13:59,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, SPMClearTaskVDSCommand, log id: 30569af9 >2014-08-25 15:13:59,218 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-17) BaseAsyncTask::RemoveTaskFromDB: Removed task 3796b8d1-a25e-4552-b0d8-3fd4f7660811 from DataBase >2014-08-25 15:13:59,218 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-17) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 43ae438f-193c-4260-aade-2a05f8beaef0 >2014-08-25 15:14:04,064 WARN [org.ovirt.engine.core.bll.DetachDiskFromVmCommand] (ajp-/127.0.0.1:8702-1) [43c37189] CanDoAction of action DetachDiskFromVm failed. Reasons:VAR__ACTION__DETACH_ACTION_TO,VAR__TYPE__VM_DISK,ERROR_CANNOT_DETACH_DISK_WITH_SNAPSHOT >2014-08-25 15:14:24,013 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-5) [4312f2a3] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:14:24,059 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-5) [4312f2a3] Running command: RemoveSnapshotCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 15:14:24,066 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp-/127.0.0.1:8702-5) [4312f2a3] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:14:24,078 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp-/127.0.0.1:8702-5) [3de72605] Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-25 15:14:24,101 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-5) [3de72605] START, MergeSnapshotsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageId = 09ce4838-ca47-412a-ad87-c87ed3432ecd, imageId2 = 892a1726-bc86-4550-8d10-6174710b8630, vmId = 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, postZero = false), log id: 2b4cd740 >2014-08-25 15:14:24,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-5) [3de72605] FINISH, MergeSnapshotsVDSCommand, log id: 2b4cd740 >2014-08-25 15:14:24,523 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-5) [3de72605] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562 >2014-08-25 15:14:24,523 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [3de72605] CommandMultiAsyncTasks::AttachTask: Attaching task c1d6bf45-774b-490c-8137-d00c8653c89b to command 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562. >2014-08-25 15:14:24,544 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [3de72605] Adding task c1d6bf45-774b-490c-8137-d00c8653c89b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:14:24,553 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp-/127.0.0.1:8702-5) [7e43b201] Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage >2014-08-25 15:14:24,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-5) [7e43b201] START, MergeSnapshotsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageId = 9b809bd0-c89e-46c8-b088-82953fa434dc, imageId2 = f04c864b-6698-4aa6-b855-ea9c1ba5b2d1, vmId = 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, postZero = false), log id: 1bd066bd >2014-08-25 15:14:24,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp-/127.0.0.1:8702-5) [7e43b201] FINISH, MergeSnapshotsVDSCommand, log id: 1bd066bd >2014-08-25 15:14:24,992 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-5) [7e43b201] CommandMultiAsyncTasks::AttachTask: Attaching task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 to command 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562. >2014-08-25 15:14:24,997 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-5) [7e43b201] Adding task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:14:25,009 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [7e43b201] Correlation ID: 4312f2a3, Job ID: f5768f38-41c3-4e7c-9dc4-dcb104f25f22, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ffff' deletion for VM 'jebatrhevh' was initiated by admin. >2014-08-25 15:14:25,009 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [7e43b201] BaseAsyncTask::startPollingTask: Starting to poll task c1d6bf45-774b-490c-8137-d00c8653c89b. >2014-08-25 15:14:25,009 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-5) [7e43b201] BaseAsyncTask::startPollingTask: Starting to poll task 1055dc46-0844-4c0b-97cb-4ed10295ddc2. >2014-08-25 15:14:29,124 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Polling and updating Async Tasks: 6 tasks, 2 tasks to poll now >2014-08-25 15:14:29,140 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] SPMAsyncTask::PollTask: Polling task c1d6bf45-774b-490c-8137-d00c8653c89b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-25 15:14:29,140 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] SPMAsyncTask::PollTask: Polling task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-25 15:14:29,140 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-36) [4b0e6a76] Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 15:14:46,144 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-26) [450d153] Setting new tasks map. The map contains now 3 tasks >2014-08-25 15:14:49,152 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-98) [472683e8] Polling and updating Async Tasks: 3 tasks, 2 tasks to poll now >2014-08-25 15:14:49,162 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-98) [472683e8] Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 15:15:16,145 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-78) [14693abb] Setting new tasks map. The map contains now 2 tasks >2014-08-25 15:15:19,184 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-30) [50d04c2] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2014-08-25 15:15:19,194 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-30) [50d04c2] Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 15:15:27,092 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:18:19,401 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] SPMAsyncTask::PollTask: Polling task c1d6bf45-774b-490c-8137-d00c8653c89b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:18:19,410 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] BaseAsyncTask::OnTaskEndSuccess: Task c1d6bf45-774b-490c-8137-d00c8653c89b (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:18:19,411 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] Task with DB Task ID e2c38c2b-7d23-4a20-b064-34c30631d14f and VDSM Task ID 1055dc46-0844-4c0b-97cb-4ed10295ddc2 is in state Polling. End action for command 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562 will proceed when all the entitys tasks are completed. >2014-08-25 15:18:19,411 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] SPMAsyncTask::PollTask: Polling task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:18:19,415 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] BaseAsyncTask::OnTaskEndSuccess: Task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:18:19,415 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] CommandAsyncTask::EndActionIfNecessary: All tasks of command 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562 has ended -> executing endAction >2014-08-25 15:18:19,415 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-33) [4bdee3c7] CommandAsyncTask::endAction: Ending action for 2 tasks (command ID: 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562): calling endAction . >2014-08-25 15:18:19,415 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-29) [4bdee3c7] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction RemoveSnapshot, executionIndex: 0 >2014-08-25 15:18:19,425 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (org.ovirt.thread.pool-4-thread-29) [4312f2a3] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotCommand >2014-08-25 15:18:19,437 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (org.ovirt.thread.pool-4-thread-29) [7e43b201] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand >2014-08-25 15:18:19,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-29) [7e43b201] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 89524120-a4cb-4f8e-98e7-35b3062aeee9, imageId = f04c864b-6698-4aa6-b855-ea9c1ba5b2d1), log id: 4fc70758 >2014-08-25 15:18:19,475 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-29) [7e43b201] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@ebeb406, log id: 4fc70758 >2014-08-25 15:18:19,480 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (org.ovirt.thread.pool-4-thread-29) [3de72605] Ending command successfully: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand >2014-08-25 15:18:19,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-29) [3de72605] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, imageId = 892a1726-bc86-4550-8d10-6174710b8630), log id: 1fa274a6 >2014-08-25 15:18:19,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-29) [3de72605] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@bb75d7d0, log id: 1fa274a6 >2014-08-25 15:18:19,525 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) Correlation ID: 4312f2a3, Job ID: f5768f38-41c3-4e7c-9dc4-dcb104f25f22, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'ffff' deletion for VM 'jebatrhevh' has been completed. >2014-08-25 15:18:19,525 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveSnapshot completed, handling the result. >2014-08-25 15:18:19,525 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveSnapshot succeeded, clearing tasks. >2014-08-25 15:18:19,528 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-29) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 >2014-08-25 15:18:19,528 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 1055dc46-0844-4c0b-97cb-4ed10295ddc2), log id: 4cb2c096 >2014-08-25 15:18:19,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=1055dc46-0844-4c0b-97cb-4ed10295ddc2), log id: 6b81df30 >2014-08-25 15:18:19,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) FINISH, HSMClearTaskVDSCommand, log id: 6b81df30 >2014-08-25 15:18:19,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) FINISH, SPMClearTaskVDSCommand, log id: 4cb2c096 >2014-08-25 15:18:19,567 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-29) BaseAsyncTask::RemoveTaskFromDB: Removed task 1055dc46-0844-4c0b-97cb-4ed10295ddc2 from DataBase >2014-08-25 15:18:19,567 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-29) SPMAsyncTask::ClearAsyncTask: Attempting to clear task c1d6bf45-774b-490c-8137-d00c8653c89b >2014-08-25 15:18:19,567 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = c1d6bf45-774b-490c-8137-d00c8653c89b), log id: 405fb202 >2014-08-25 15:18:19,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=c1d6bf45-774b-490c-8137-d00c8653c89b), log id: 4a9fc252 >2014-08-25 15:18:19,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) FINISH, HSMClearTaskVDSCommand, log id: 4a9fc252 >2014-08-25 15:18:19,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-29) FINISH, SPMClearTaskVDSCommand, log id: 405fb202 >2014-08-25 15:18:19,640 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-29) BaseAsyncTask::RemoveTaskFromDB: Removed task c1d6bf45-774b-490c-8137-d00c8653c89b from DataBase >2014-08-25 15:18:19,640 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-29) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 7bafd575-6be0-42b3-b2fc-ae2fe4cdf562 >2014-08-25 15:18:37,596 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (ajp-/127.0.0.1:8702-3) [68550dbf] Lock Acquired to object EngineLock [exclusiveLocks= key: 101daa5c-71ae-43be-9c60-688659531a3c value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 15:18:37,620 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-16) [68550dbf] Running command: RemoveDiskCommand internal: false. Entities affected : ID: 101daa5c-71ae-43be-9c60-688659531a3c Type: Disk >2014-08-25 15:18:37,622 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] Running command: RemoveImageCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 15:18:37,637 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] START, DeleteImageGroupVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 101daa5c-71ae-43be-9c60-688659531a3c, postZeros = false, forceDelete = false), log id: 4812ddcd >2014-08-25 15:18:38,023 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] FINISH, DeleteImageGroupVDSCommand, log id: 4812ddcd >2014-08-25 15:18:38,032 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 6658f5b2-262f-42a2-90ce-f3f82cb1d290 >2014-08-25 15:18:38,032 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] CommandMultiAsyncTasks::AttachTask: Attaching task 167e08ac-190a-42d5-a7ee-9f071480c88a to command 6658f5b2-262f-42a2-90ce-f3f82cb1d290. >2014-08-25 15:18:38,044 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] Adding task 167e08ac-190a-42d5-a7ee-9f071480c88a (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 15:18:38,094 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] Correlation ID: 68550dbf, Job ID: b81d6222-c48f-4571-9252-adf15e34f145, Call Stack: null, Custom Event ID: -1, Message: Disk jebatrhevh_Disk3 was successfully removed from domain n2 (User admin. >2014-08-25 15:18:38,094 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] BaseAsyncTask::startPollingTask: Starting to poll task 167e08ac-190a-42d5-a7ee-9f071480c88a. >2014-08-25 15:18:38,094 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-16) [7c65e91b] Lock freed to object EngineLock [exclusiveLocks= key: 101daa5c-71ae-43be-9c60-688659531a3c value: DISK >, sharedLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >] >2014-08-25 15:18:39,416 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] Polling and updating Async Tasks: 3 tasks, 1 tasks to poll now >2014-08-25 15:18:39,426 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] SPMAsyncTask::PollTask: Polling task 167e08ac-190a-42d5-a7ee-9f071480c88a (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 15:18:39,430 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] BaseAsyncTask::OnTaskEndSuccess: Task 167e08ac-190a-42d5-a7ee-9f071480c88a (Parent Command RemoveDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 15:18:39,431 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] CommandAsyncTask::EndActionIfNecessary: All tasks of command 6658f5b2-262f-42a2-90ce-f3f82cb1d290 has ended -> executing endAction >2014-08-25 15:18:39,431 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-97) [2be0dd7a] CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 6658f5b2-262f-42a2-90ce-f3f82cb1d290): calling endAction . >2014-08-25 15:18:39,432 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-18) [2be0dd7a] CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction RemoveDisk, executionIndex: 0 >2014-08-25 15:18:39,441 INFO [org.ovirt.engine.core.bll.RemoveDiskCommand] (org.ovirt.thread.pool-4-thread-18) [2be0dd7a] Ending command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand >2014-08-25 15:18:39,442 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-18) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveDisk completed, handling the result. >2014-08-25 15:18:39,442 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-18) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type RemoveDisk succeeded, clearing tasks. >2014-08-25 15:18:39,445 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-18) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 167e08ac-190a-42d5-a7ee-9f071480c88a >2014-08-25 15:18:39,446 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-18) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 167e08ac-190a-42d5-a7ee-9f071480c88a), log id: 7166da50 >2014-08-25 15:18:39,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-18) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=167e08ac-190a-42d5-a7ee-9f071480c88a), log id: 1fbcabbb >2014-08-25 15:18:39,527 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-18) FINISH, HSMClearTaskVDSCommand, log id: 1fbcabbb >2014-08-25 15:18:39,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-18) FINISH, SPMClearTaskVDSCommand, log id: 7166da50 >2014-08-25 15:18:39,531 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-18) BaseAsyncTask::RemoveTaskFromDB: Removed task 167e08ac-190a-42d5-a7ee-9f071480c88a from DataBase >2014-08-25 15:18:39,531 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-18) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 6658f5b2-262f-42a2-90ce-f3f82cb1d290 >2014-08-25 15:19:46,149 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) [4a00aa00] Setting new tasks map. The map contains now 0 tasks >2014-08-25 15:19:46,149 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-10) [4a00aa00] Cleared all tasks of pool 00000002-0002-0002-0002-000000000135. >2014-08-25 15:22:32,897 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [4b86906f] Lock Acquired to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:22:32,930 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4b86906f] START, IsVmDuringInitiatingVDSCommand( vmId = 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3), log id: 36773cf6 >2014-08-25 15:22:32,930 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4b86906f] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 36773cf6 >2014-08-25 15:22:32,973 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] Running command: RunVmCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 15:22:33,035 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] START, CreateVmVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, vm=VM [jebatrhevh]), log id: 18bf3780 >2014-08-25 15:22:33,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] START, CreateVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, vm=VM [jebatrhevh]), log id: 2486ce55 >2014-08-25 15:22:33,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=92d6c670-9fb8-48df-b97d-53c504079fe3}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=dfb732c2-05e8-47a5-b41a-4c756511a76f}, {shared=false, index=0, volumeID=f04c864b-6698-4aa6-b855-ea9c1ba5b2d1, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=2, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=89524120-a4cb-4f8e-98e7-35b3062aeee9, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=89524120-a4cb-4f8e-98e7-35b3062aeee9}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0d, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=763cd95d-1b6a-4efa-80ca-95f8be327699}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=1d02d789-6b5f-484f-99c3-521e9d8ea53f}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=73827140-21af-4201-afc9-f7914f4f9e20}],acpiEnable=true,vmName=jebatrhevh,cpuType=Westmere,custom={device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=f8591146-0a96-411e-bde9-4eed8d59b3a3, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273device_4f642a4d-ad04-498d-8e61-a1aaae781c23=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=4f642a4d-ad04-498d-8e61-a1aaae781c23, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=d704a640-a9ea-4dc6-8bf0-b622f3b55312, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273device_4f642a4d-ad04-498d-8e61-a1aaae781c23device_00d419cb-053b-4a4e-b599-4e2d38c5e525=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=00d419cb-053b-4a4e-b599-4e2d38c5e525, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=011460df-50c7-43ec-862e-0e3919097273, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}} >2014-08-25 15:22:33,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] FINISH, CreateVDSCommand, log id: 2486ce55 >2014-08-25 15:22:33,169 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 18bf3780 >2014-08-25 15:22:33,169 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-20) [4b86906f] Lock freed to object EngineLock [exclusiveLocks= key: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 value: VM >, sharedLocks= ] >2014-08-25 15:22:33,176 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-20) [4b86906f] Correlation ID: 4b86906f, Job ID: 349c1484-2cf3-4475-bc44-530948a313f3, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh was started by admin (Host: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-25 15:22:34,314 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) [7e433129] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from WaitForLaunch --> PoweringUp >2014-08-25 15:22:34,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-28) [7e433129] START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[934ffff5-6fcd-4a73-86d6-6ae8e7265ea3]), log id: 48f0246 >2014-08-25 15:22:34,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-28) [7e433129] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, acpiEnable=true, custom={device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=f8591146-0a96-411e-bde9-4eed8d59b3a3, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273device_4f642a4d-ad04-498d-8e61-a1aaae781c23=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=4f642a4d-ad04-498d-8e61-a1aaae781c23, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=d704a640-a9ea-4dc6-8bf0-b622f3b55312, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273device_4f642a4d-ad04-498d-8e61-a1aaae781c23device_00d419cb-053b-4a4e-b599-4e2d38c5e525=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=00d419cb-053b-4a4e-b599-4e2d38c5e525, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_d704a640-a9ea-4dc6-8bf0-b622f3b55312device_f8591146-0a96-411e-bde9-4eed8d59b3a3device_011460df-50c7-43ec-862e-0e3919097273=VmDevice {vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, deviceId=011460df-50c7-43ec-862e-0e3919097273, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=18721, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@48de4400, vmName=jebatrhevh, cpuType=Westmere}], log id: 48f0246 >2014-08-25 15:22:45,520 INFO [org.ovirt.engine.core.bll.storage.UpdateStoragePoolCommand] (org.ovirt.thread.pool-4-thread-12) [15e6c012] Running command: UpdateStoragePoolCommand internal: false. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 15:22:45,522 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetStoragePoolDescriptionVDSCommand] (org.ovirt.thread.pool-4-thread-12) [15e6c012] START, SetStoragePoolDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, description = Default_foobar), log id: 1effe233 >2014-08-25 15:22:45,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetStoragePoolDescriptionVDSCommand] (org.ovirt.thread.pool-4-thread-12) [15e6c012] FINISH, SetStoragePoolDescriptionVDSCommand, log id: 1effe233 >2014-08-25 15:22:45,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [15e6c012] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Data Center Default was renamed from Default to Default_foobar. >2014-08-25 15:22:45,669 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [15e6c012] Correlation ID: 15e6c012, Job ID: 137eccef-47c2-4645-bf93-bde0acb2a77d, Call Stack: null, Custom Event ID: -1, Message: Data Center Default_foobar was updated by admin >2014-08-25 15:22:59,519 INFO [org.ovirt.engine.core.bll.storage.UpdateStorageDomainCommand] (ajp-/127.0.0.1:8702-4) [56106937] Running command: UpdateStorageDomainCommand internal: false. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 15:22:59,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetStorageDomainDescriptionVDSCommand] (ajp-/127.0.0.1:8702-4) [56106937] START, SetStorageDomainDescriptionVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, description = n2_foo_bar), log id: 404411a8 >2014-08-25 15:22:59,592 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SetStorageDomainDescriptionVDSCommand] (ajp-/127.0.0.1:8702-4) [56106937] FINISH, SetStorageDomainDescriptionVDSCommand, log id: 404411a8 >2014-08-25 15:22:59,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [56106937] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage n2 was renamed from n2 to n2_foo_bar. >2014-08-25 15:22:59,611 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [56106937] Correlation ID: 56106937, Call Stack: null, Custom Event ID: -1, Message: Storage Domain n2_foo_bar was updated by admin >2014-08-25 15:23:15,042 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-4) [730fc15b] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 Type: VM >2014-08-25 15:23:15,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [730fc15b] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, ticket=5iVlUSpinHNq, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4281eb36 >2014-08-25 15:23:15,072 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [730fc15b] FINISH, SetVmTicketVDSCommand, log id: 4281eb36 >2014-08-25 15:23:15,082 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [730fc15b] Correlation ID: 730fc15b, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM jebatrhevh >2014-08-25 15:23:16,916 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-73) [3d89d729] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM jebatrhevh. >2014-08-25 15:23:35,095 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) [7c5190b2] VM jebatrhevh 934ffff5-6fcd-4a73-86d6-6ae8e7265ea3 moved from PoweringUp --> Up >2014-08-25 15:23:35,104 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [7c5190b2] Correlation ID: 4b86906f, Job ID: 349c1484-2cf3-4475-bc44-530948a313f3, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh started on Host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 15:23:35,109 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:24:05,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] START, DestroyVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=934ffff5-6fcd-4a73-86d6-6ae8e7265ea3, force=false, secondsToWait=0, gracefully=false), log id: 2384b26e >2014-08-25 15:24:05,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] FINISH, DestroyVDSCommand, log id: 2384b26e >2014-08-25 15:24:05,449 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM jebatrhevh is down. Exit message: User shut down >2014-08-25 15:24:05,451 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-93) [1ffd51c9] VM jebatrhevh (934ffff5-6fcd-4a73-86d6-6ae8e7265ea3) is running in db and not running in VDS slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 15:24:05,462 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-29) [bc5f8eb] Running command: ProcessDownVmCommand internal: true. >2014-08-25 15:28:03,341 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.conf". >2014-08-25 15:28:03,353 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) The file "/etc/ovirt-engine/engine.conf" doesn't exist or isn't readable. Will return an empty set of properties. >2014-08-25 15:28:03,353 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-rhevm-doc.conf". >2014-08-25 15:28:03,353 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-database.conf". >2014-08-25 15:28:03,354 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-jboss.conf". >2014-08-25 15:28:03,354 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-pki.conf". >2014-08-25 15:28:03,354 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/10-setup-protocols.conf". >2014-08-25 15:28:03,354 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/20-branding-rhev.conf". >2014-08-25 15:28:03,354 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Loaded file "/etc/ovirt-engine/engine.conf.d/50-redhat-support-plugin.conf". >2014-08-25 15:28:03,404 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_ENABLED" is "true". >2014-08-25 15:28:03,404 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_AJP_PORT" is "8702". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_APPS" is "engine.ear "/usr/share/ovirt-engine/branding/rhev-1.brand/applications/rhev.ear" redhat-support-plugin-rhev.ear". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_CACHE" is "/var/cache/ovirt-engine". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CHECK_INTERVAL" is "1000". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_CONNECTION_TIMEOUT" is "300000". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DATABASE" is "engine". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_DRIVER" is "org.postgresql.Driver". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_HOST" is "localhost". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MAX_CONNECTIONS" is "100". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_MIN_CONNECTIONS" is "1". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PASSWORD" is "***". >2014-08-25 15:28:03,405 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_PORT" is "5432". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED" is "False". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_SECURED_VALIDATION" is "False". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_URL" is "jdbc:postgresql://localhost:5432/engine?sslfactory=org.postgresql.ssl.NonValidatingFactory". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DB_USER" is "engine". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DEBUG_ADDRESS" is "". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_DOC" is "/usr/share/doc/ovirt-engine". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_ETC" is "/etc/ovirt-engine". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_FQDN" is "pb-rh34.rhev.lab.eng.brq.redhat.com". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_GROUP" is "ovirt". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MAX" is "1g". >2014-08-25 15:28:03,406 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HEAP_MIN" is "1g". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_ENABLED" is "false". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PORT" is "None". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTPS_PROTOCOLS" is "SSLv3,TLSv1,TLSv1.1,TLSv1.2". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_ENABLED" is "false". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_HTTP_PORT" is "None". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JAVA_MODULEPATH" is "/usr/share/ovirt-engine/modules". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_JVM_ARGS" is " -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="/var/log/ovirt-engine/dump"". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG" is "/var/log/ovirt-engine". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_LOG_TO_CONSOLE" is "false". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_MANUAL" is "/usr/share/doc/rhevm-doc/manual". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MAX" is "256m". >2014-08-25 15:28:03,407 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PERM_MIN" is "256m". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI" is "/etc/pki/ovirt-engine". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_CA" is "/etc/pki/ovirt-engine/ca.pem". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_CERT" is "/etc/pki/ovirt-engine/certs/engine.cer". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE" is "/etc/pki/ovirt-engine/keys/engine.p12". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_ALIAS" is "1". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_ENGINE_STORE_PASSWORD" is "***". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE" is "/etc/pki/ovirt-engine/.truststore". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PKI_TRUST_STORE_PASSWORD" is "***". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROPERTIES" is " jsse.enableSNIExtension=false". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_ENABLED" is "true". >2014-08-25 15:28:03,408 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTPS_PORT" is "443". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_PROXY_HTTP_PORT" is "80". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_REPORTS_UI" is "/var/lib/ovirt-engine/reports.xml". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_INTERVAL" is "1". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_STOP_TIME" is "10". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_TMP" is "/var/tmp/ovirt-engine". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_UP_MARK" is "/var/lib/ovirt-engine/engine.up". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_URI" is "/ovirt-engine". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USER" is "ovirt". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_USR" is "/usr/share/ovirt-engine". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VAR" is "/var/lib/ovirt-engine". >2014-08-25 15:28:03,409 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "ENGINE_VERBOSE_GC" is "false". >2014-08-25 15:28:03,410 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_HOME" is "/usr/share/jbossas". >2014-08-25 15:28:03,410 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "JBOSS_RUNTIME" is "/var/lib/ovirt-engine/jboss_runtime". >2014-08-25 15:28:03,410 INFO [org.ovirt.engine.core.utils.LocalConfig] (ServerService Thread Pool -- 37) Value of property "SENSITIVE_KEYS" is ",ENGINE_DB_PASSWORD,ENGINE_PKI_TRUST_STORE_PASSWORD,ENGINE_PKI_ENGINE_STORE_PASSWORD". >2014-08-25 15:28:05,125 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Start initializing Backend >2014-08-25 15:28:05,693 INFO [org.ovirt.engine.core.utils.osinfo.OsInfoPreferencesLoader] (ServerService Thread Pool -- 37) Loaded file /etc/ovirt-engine/osinfo.conf.d/00-defaults.properties >2014-08-25 15:28:05,831 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Running ovirt-engine 3.4.2-0.2.el6ev >2014-08-25 15:28:05,832 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 37) Start initializing dictionaries >2014-08-25 15:28:05,836 INFO [org.ovirt.engine.core.bll.CpuFlagsManagerHandler] (ServerService Thread Pool -- 37) Finished initializing dictionaries >2014-08-25 15:28:05,837 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Start initializing AuditLogCleanupManager >2014-08-25 15:28:05,837 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Setting audit cleanup manager to run at: 35 35 3 * * ? >2014-08-25 15:28:05,876 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 37) Finished initializing AuditLogCleanupManager >2014-08-25 15:28:05,879 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Start initializing TagsDirector >2014-08-25 15:28:05,890 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag root added to tree >2014-08-25 15:28:05,904 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag foo added to tree >2014-08-25 15:28:05,907 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag foo added as child to parent root >2014-08-25 15:28:05,914 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag bar added to tree >2014-08-25 15:28:05,915 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Tag bar added as child to parent root >2014-08-25 15:28:05,940 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 37) Finished initializing TagsDirector >2014-08-25 15:28:05,945 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 37) Start initializing IsoDomainListSyncronizer >2014-08-25 15:28:05,951 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (ServerService Thread Pool -- 37) Finished initializing IsoDomainListSyncronizer >2014-08-25 15:28:06,053 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Completed initializing handlers >2014-08-25 15:28:06,054 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Start initializing ErrorTranslatorImpl >2014-08-25 15:28:06,068 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Code MAC_ADDRESS_IS_IN_USE appears more than once in string table. >2014-08-25 15:28:06,070 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Finished initializing ErrorTranslatorImpl >2014-08-25 15:28:06,070 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Start initializing ErrorTranslatorImpl >2014-08-25 15:28:06,070 INFO [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 37) Finished initializing ErrorTranslatorImpl >2014-08-25 15:28:06,071 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 37) Mark incomplete jobs as UNKNOWN >2014-08-25 15:28:06,109 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 37) Start initializing JobRepositoryCleanupManager >2014-08-25 15:28:06,109 INFO [org.ovirt.engine.core.bll.job.JobRepositoryCleanupManager] (ServerService Thread Pool -- 37) Finished initializing JobRepositoryCleanupManager >2014-08-25 15:28:06,111 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 37) Start initializing AutoRecoveryManager >2014-08-25 15:28:06,112 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (ServerService Thread Pool -- 37) Finished initializing AutoRecoveryManager >2014-08-25 15:28:06,114 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 37) Start initializing ExecutionMessageDirector >2014-08-25 15:28:06,115 INFO [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ServerService Thread Pool -- 37) Finished initializing ExecutionMessageDirector >2014-08-25 15:28:06,174 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Start initializing UsersDomainsCacheManagerService >2014-08-25 15:28:06,183 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Start initializing DbUserCacheManager >2014-08-25 15:28:06,190 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (ServerService Thread Pool -- 43) Finished initializing DbUserCacheManager >2014-08-25 15:28:06,190 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 43) Finished initializing UsersDomainsCacheManagerService >2014-08-25 15:28:06,196 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 37) Initialization of AsyncTaskManager completed successfully. >2014-08-25 15:28:06,199 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) Start initializing ResourceManager >2014-08-25 15:28:06,372 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Entered VdsManager constructor >2014-08-25 15:28:06,402 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Initialize vdsBroker (slot-7.rhev.lab.eng.brq.redhat.com,54,321) >2014-08-25 15:28:06,573 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) VDS db0a9d36-feed-4855-9ea1-cfa0ccc52b0f was added to the Resource Manager >2014-08-25 15:28:06,597 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) Finished initializing ResourceManager >2014-08-25 15:28:06,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (ServerService Thread Pool -- 37) Initialization of OvfDataUpdater completed successfully. >2014-08-25 15:28:06,615 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Start scheduling to enable vds load balancer >2014-08-25 15:28:06,616 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Finished scheduling to enable vds load balancer >2014-08-25 15:28:06,616 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Start HA Reservation check >2014-08-25 15:28:06,616 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Finished HA Reservation check >2014-08-25 15:28:06,631 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(e098a79): Start initializing >2014-08-25 15:28:06,657 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) Init VM custom properties utilities >2014-08-25 15:28:06,658 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) Init device custom properties utilities >2014-08-25 15:28:06,662 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Initializing Scheduling manager >2014-08-25 15:28:06,697 INFO [org.ovirt.engine.core.bll.network.MacPoolManager] (org.ovirt.thread.pool-4-thread-1) MacPoolManager(e098a79): Finished initializing. Available MACs in pool: 253 >2014-08-25 15:28:06,709 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) External scheduler disabled, discovery skipped >2014-08-25 15:28:06,709 INFO [org.ovirt.engine.core.bll.scheduling.SchedulingManager] (ServerService Thread Pool -- 37) Initialized Scheduling manager >2014-08-25 15:28:06,709 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 37) Initializing DWH Heart Beat >2014-08-25 15:28:06,710 INFO [org.ovirt.engine.core.bll.dwh.DwhHeartBeat] (ServerService Thread Pool -- 37) DWH Heart Beat initialized >2014-08-25 15:28:10,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GetHardwareInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f]), log id: 7313328 >2014-08-25 15:28:10,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GetHardwareInfoVDSCommand, log id: 7313328 >2014-08-25 15:28:10,526 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: UNASSIGNED not exist in string table >2014-08-25 15:28:10,526 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS not exist in string table >2014-08-25 15:28:10,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_STATUS_FAILED not exist in string table >2014-08-25 15:28:10,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_AUTO_FENCE_FAILED_CALL_FENCE_SPM not exist in string table >2014-08-25 15:28:10,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_HIGH_NETWORK_USE not exist in string table >2014-08-25 15:28:10,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_REMOVE_VM not exist in string table >2014-08-25 15:28:10,528 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2014-08-25 15:28:10,528 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2014-08-25 15:28:10,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2014-08-25 15:28:10,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STOPPED not exist in string table >2014-08-25 15:28:10,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_STARTED not exist in string table >2014-08-25 15:28:10,529 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: DWH_ERROR not exist in string table >2014-08-25 15:28:10,543 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_REMOVE_VM not have severity. Assumed Normal >2014-08-25 15:28:10,543 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_VOLUME_OPTION_CHANGED_FROM_CLI not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_SERVICES_LIST_NOT_FETCHED not have severity. Assumed Normal >2014-08-25 15:28:10,544 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: GLUSTER_VOLUME_BRICK_ADDED not have severity. Assumed Normal >2014-08-25 15:28:10,545 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2014-08-25 15:28:10,545 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2014-08-25 15:28:10,545 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_UP not have severity. Assumed Normal >2014-08-25 15:28:10,545 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: NETWORK_UPDATE_VM_INTERFACE_LINK_DOWN not have severity. Assumed Normal >2014-08-25 15:28:10,546 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: CLUSTER_ALERT_HA_RESERVATION_DOWN not have severity. Assumed Normal >2014-08-25 15:28:10,546 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_ADDED_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,546 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_ADD_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,546 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_UPDATED_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,546 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_UPDATE_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,547 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_REMOVED_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,547 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) AuditLogType: USER_FAILED_TO_REMOVE_AFFINITY_GROUP not have severity. Assumed Normal >2014-08-25 15:28:10,640 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-7.rhev.lab.eng.brq.redhat.com. >2014-08-25 15:28:10,766 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) Initializing Host: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 15:28:11,002 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [33270fe6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-08-25 15:28:16,209 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-08-25 15:28:16,622 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-25 15:28:16,641 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-7) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-08-25 15:28:16,667 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-19) [6d88040a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-08-25 15:28:16,714 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-19) [6d88040a] Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : null >2014-08-25 15:28:16,892 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [6d88040a] Correlation ID: 6d88040a, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default_foobar. Setting status to Non Responsive. >2014-08-25 15:28:16,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-19) [6d88040a] hostFromVds::selectedVds - slot-7.rhev.lab.eng.brq.redhat.com, spmStatus SPM, storage pool Default_foobar >2014-08-25 15:28:17,003 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-19) [6d88040a] Initialize Irs proxy from vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 15:28:17,051 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [6d88040a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host slot-7.rhev.lab.eng.brq.redhat.com (Address: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-25 15:28:17,342 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6d88040a] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 7951501f >2014-08-25 15:28:17,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6d88040a] -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-08-25 15:28:17,492 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6d88040a] START, HSMGetAllTasksInfoVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 5e392f5f >2014-08-25 15:28:17,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6d88040a] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 5e392f5f >2014-08-25 15:28:17,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-13) [6d88040a] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 7951501f >2014-08-25 15:28:17,549 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-13) [6d88040a] Discovered no tasks on Storage Pool Default_foobar >2014-08-25 15:29:36,191 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-2) Reading UI plugin descriptor [/usr/share/ovirt-engine/ui-plugins/redhat_support_plugin_rhev.json] >2014-08-25 15:29:36,207 INFO [org.ovirt.engine.ui.frontend.server.gwt.plugin.PluginDataManager] (ajp-/127.0.0.1:8702-2) Reading UI plugin configuration [/etc/ovirt-engine/ui-plugins/redhat_support_plugin_rhev-config.json] >2014-08-25 15:32:14,854 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:33:00,392 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:34:31,582 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:36:33,188 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:40:20,856 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:43:07,732 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:43:53,220 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:46:40,106 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:50:57,874 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 15:51:43,332 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:03:20,752 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:07:07,997 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:28:06,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-08-25 16:28:06,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 16:28:06,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-11) START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 26faf266 >2014-08-25 16:28:07,312 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, UpdateVMVDSCommand, log id: 26faf266 >2014-08-25 16:28:07,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 16:28:07,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 16:28:07,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 16:28:07,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 16:28:07,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 16:28:51,107 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:29:06,265 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:33:23,995 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:34:09,448 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 16:38:57,442 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:03:57,434 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 0 tasks in the queue. >2014-08-25 17:14:03,380 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:28:07,339 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-08-25 17:28:07,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 17:28:07,342 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 17:28:07,342 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 17:28:07,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 17:28:07,344 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 17:28:07,345 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 17:43:50,917 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:48:25,727 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-2) Running command: LoginAdminUserCommand internal: false. >2014-08-25 17:48:25,736 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-25 17:48:26,036 ERROR [org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTServiceImpl] (ajp-/127.0.0.1:8702-9) Retrieving non string value from session >2014-08-25 17:48:26,438 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-4) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-08-25 17:48:59,834 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [9a0fc60] Lock Acquired to object EngineLock [exclusiveLocks= key: av11.1 value: VM_NAME >, sharedLocks= ] >2014-08-25 17:48:59,941 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [9a0fc60] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-08-25 17:49:00,290 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [9a0fc60] Correlation ID: 9a0fc60, Job ID: 782af903-7a2e-4475-9ec2-57e359f30c52, Call Stack: null, Custom Event ID: -1, Message: VM av11.1 was created by admin. >2014-08-25 17:49:00,306 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-6) [9a0fc60] Lock freed to object EngineLock [exclusiveLocks= key: av11.1 value: VM_NAME >, sharedLocks= ] >2014-08-25 17:49:01,108 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-5) [4a5a9c5a] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM >2014-08-25 17:49:05,547 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-7) [44543f5a] Lock Acquired to object EngineLock [exclusiveLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM_DISK_BOOT >, sharedLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM >] >2014-08-25 17:49:05,583 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-7) [44543f5a] Running command: AddDiskCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM, ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 17:49:05,815 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-7) [7f231a20] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-25 17:49:05,862 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-7) [7f231a20] Lock freed to object EngineLock [exclusiveLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM_DISK_BOOT >, sharedLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM >] >2014-08-25 17:49:05,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [7f231a20] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 3e238976-7fe7-45b7-aa89-900d76e98af0, imageSizeInBytes = 10737418240, volumeFormat = RAW, newImageId = aca792b7-5b31-42cb-81bb-4baace462ac4, newImageDescription = ), log id: 7b2e3b05 >2014-08-25 17:49:05,865 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [7f231a20] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-25 17:49:06,132 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-7) [7f231a20] FINISH, CreateImageVDSCommand, return: aca792b7-5b31-42cb-81bb-4baace462ac4, log id: 7b2e3b05 >2014-08-25 17:49:06,370 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-7) [7f231a20] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 0c6473f0-2e8a-4ac9-8c55-4e05866bba30 >2014-08-25 17:49:06,371 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-7) [7f231a20] CommandMultiAsyncTasks::AttachTask: Attaching task 7095e134-df84-428d-a966-143e9e5922e2 to command 0c6473f0-2e8a-4ac9-8c55-4e05866bba30. >2014-08-25 17:49:06,410 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-7) [7f231a20] Adding task 7095e134-df84-428d-a966-143e9e5922e2 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-25 17:49:06,466 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [7f231a20] Correlation ID: 44543f5a, Job ID: 0acb4ab1-1c30-4e1c-b1d2-dd9ff0335f92, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of av11.1_Disk1 was initiated on VM av11.1 by admin. >2014-08-25 17:49:06,466 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-7) [7f231a20] BaseAsyncTask::startPollingTask: Starting to poll task 7095e134-df84-428d-a966-143e9e5922e2. >2014-08-25 17:49:06,746 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-25 17:49:06,760 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-44) SPMAsyncTask::PollTask: Polling task 7095e134-df84-428d-a966-143e9e5922e2 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status running. >2014-08-25 17:49:06,760 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-44) Finished polling Tasks, will poll again in 10 seconds. >2014-08-25 17:49:16,769 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) SPMAsyncTask::PollTask: Polling task 7095e134-df84-428d-a966-143e9e5922e2 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-25 17:49:16,777 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-68) BaseAsyncTask::OnTaskEndSuccess: Task 7095e134-df84-428d-a966-143e9e5922e2 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-25 17:49:16,777 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-68) CommandAsyncTask::EndActionIfNecessary: All tasks of command 0c6473f0-2e8a-4ac9-8c55-4e05866bba30 has ended -> executing endAction >2014-08-25 17:49:16,777 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-68) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 0c6473f0-2e8a-4ac9-8c55-4e05866bba30): calling endAction . >2014-08-25 17:49:16,778 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-44) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-25 17:49:16,794 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-44) [44543f5a] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-25 17:49:16,805 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-44) [7f231a20] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-25 17:49:16,814 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) [7f231a20] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = 3e238976-7fe7-45b7-aa89-900d76e98af0, imageId = aca792b7-5b31-42cb-81bb-4baace462ac4), log id: 18a16e63 >2014-08-25 17:49:16,843 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) [7f231a20] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@ddce8f1b, log id: 18a16e63 >2014-08-25 17:49:16,866 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) Correlation ID: 44543f5a, Job ID: 0acb4ab1-1c30-4e1c-b1d2-dd9ff0335f92, Call Stack: null, Custom Event ID: -1, Message: The disk av11.1_Disk1 was successfully added to VM av11.1. >2014-08-25 17:49:16,866 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-25 17:49:16,866 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-25 17:49:16,869 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-44) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 7095e134-df84-428d-a966-143e9e5922e2 >2014-08-25 17:49:16,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 7095e134-df84-428d-a966-143e9e5922e2), log id: 77f5d5bc >2014-08-25 17:49:16,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=7095e134-df84-428d-a966-143e9e5922e2), log id: 4472e9cf >2014-08-25 17:49:16,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, HSMClearTaskVDSCommand, log id: 4472e9cf >2014-08-25 17:49:16,923 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, SPMClearTaskVDSCommand, log id: 77f5d5bc >2014-08-25 17:49:16,928 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-44) BaseAsyncTask::RemoveTaskFromDB: Removed task 7095e134-df84-428d-a966-143e9e5922e2 from DataBase >2014-08-25 17:49:16,928 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-44) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 0c6473f0-2e8a-4ac9-8c55-4e05866bba30 >2014-08-25 17:49:22,893 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [5ee0ba79] Lock Acquired to object EngineLock [exclusiveLocks= key: av11.1 value: VM_NAME >, sharedLocks= ] >2014-08-25 17:49:22,959 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [5ee0ba79] Running command: UpdateVmCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM >2014-08-25 17:49:23,007 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [5ee0ba79] Correlation ID: 5ee0ba79, Job ID: 6264802c-ec5d-4921-ac31-6d965ced85d8, Call Stack: null, Custom Event ID: -1, Message: VM av11.1 configuration was updated by admin. >2014-08-25 17:49:23,012 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [5ee0ba79] Lock freed to object EngineLock [exclusiveLocks= key: av11.1 value: VM_NAME >, sharedLocks= ] >2014-08-25 17:49:24,187 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:49:30,420 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-7) [10fc323c] Lock Acquired to object EngineLock [exclusiveLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM >, sharedLocks= ] >2014-08-25 17:49:30,457 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [10fc323c] START, IsVmDuringInitiatingVDSCommand( vmId = 4f0be376-e2f2-4c86-a07d-49663a164626), log id: 173f894f >2014-08-25 17:49:30,458 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-7) [10fc323c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 173f894f >2014-08-25 17:49:30,533 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] Running command: RunVmCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM >2014-08-25 17:49:30,599 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] START, CreateVmVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, vm=VM [av11.1]), log id: 5ef399 >2014-08-25 17:49:30,625 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] START, CreateVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, vm=VM [av11.1]), log id: 488560ab >2014-08-25 17:49:30,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=5124,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=5124,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=4f0be376-e2f2-4c86-a07d-49663a164626,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=606565f1-ba95-4ba3-bf61-5c44c01b48bb}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=e67f1ef8-d712-4e53-aa2a-08f0b76951ff}, {shared=false, index=0, volumeID=aca792b7-5b31-42cb-81bb-4baace462ac4, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=2, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=3e238976-7fe7-45b7-aa89-900d76e98af0, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=3e238976-7fe7-45b7-aa89-900d76e98af0}, {nicModel=pv, bootOrder=1, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0c, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=b475ee93-1abd-4eb4-b8a7-9f6213d96533}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=67a0b20e-384a-4f42-a506-ce3db151f49c}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=f7be465b-9f5f-483e-ba94-0ff9044bba69}],acpiEnable=true,vmName=av11.1,cpuType=Westmere,custom={} >2014-08-25 17:49:30,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] FINISH, CreateVDSCommand, log id: 488560ab >2014-08-25 17:49:30,729 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5ef399 >2014-08-25 17:49:30,729 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-47) [10fc323c] Lock freed to object EngineLock [exclusiveLocks= key: 4f0be376-e2f2-4c86-a07d-49663a164626 value: VM >, sharedLocks= ] >2014-08-25 17:49:30,743 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-47) [10fc323c] Correlation ID: 10fc323c, Job ID: 71754ce6-e756-450c-8622-f39e131160c3, Call Stack: null, Custom Event ID: -1, Message: VM av11.1 was started by admin (Host: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-25 17:49:33,238 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-99) VM av11.1 4f0be376-e2f2-4c86-a07d-49663a164626 moved from WaitForLaunch --> PoweringUp >2014-08-25 17:49:33,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[4f0be376-e2f2-4c86-a07d-49663a164626]), log id: 7f7bc5e0 >2014-08-25 17:49:33,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-99) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=5124, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=5124, display=qxl, pid=28921, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@16fc3683, vmName=av11.1, cpuType=Westmere}], log id: 7f7bc5e0 >2014-08-25 17:49:42,462 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-5) [6296d574] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM >2014-08-25 17:49:42,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [6296d574] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, ticket=jPMaLuNpm+3S, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 130c5815 >2014-08-25 17:49:42,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [6296d574] FINISH, SetVmTicketVDSCommand, log id: 130c5815 >2014-08-25 17:49:42,537 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [6296d574] Correlation ID: 6296d574, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM av11.1 >2014-08-25 17:49:48,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-39) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM av11.1. >2014-08-25 17:50:31,197 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-26) VM av11.1 4f0be376-e2f2-4c86-a07d-49663a164626 moved from PoweringUp --> Up >2014-08-25 17:50:31,209 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) Correlation ID: 10fc323c, Job ID: 71754ce6-e756-450c-8622-f39e131160c3, Call Stack: null, Custom Event ID: -1, Message: VM av11.1 started on Host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-25 17:50:36,398 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-41) Setting new tasks map. The map contains now 0 tasks >2014-08-25 17:50:36,399 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-41) Cleared all tasks of pool 00000002-0002-0002-0002-000000000135. >2014-08-25 17:51:56,176 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:54:27,602 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 17:56:58,833 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) VM av11.1 4f0be376-e2f2-4c86-a07d-49663a164626 moved from Up --> RebootInProgress >2014-08-25 17:56:58,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[4f0be376-e2f2-4c86-a07d-49663a164626]), log id: 65f944c7 >2014-08-25 17:56:58,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-59) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=5124, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=5124, display=qxl, pid=28921, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@5012991e, vmName=av11.1, cpuType=Westmere}], log id: 65f944c7 >2014-08-25 17:57:59,709 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-88) VM av11.1 4f0be376-e2f2-4c86-a07d-49663a164626 moved from RebootInProgress --> Up >2014-08-25 18:13:52,741 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 18:15:38,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 18:28:07,345 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-08-25 18:28:07,346 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 18:28:07,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-79) START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 66ec6112 >2014-08-25 18:28:07,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, UpdateVMVDSCommand, log id: 66ec6112 >2014-08-25 18:28:07,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 18:28:07,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 18:28:07,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 18:28:07,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 18:28:07,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 18:40:35,351 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 18:51:55,706 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 19:05:17,356 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-49) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal got disconnected from VM av11.1. >2014-08-25 19:28:07,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-08-25 19:28:07,519 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 19:28:07,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 19:28:07,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 19:28:07,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 19:28:07,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 19:28:07,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 20:21:40,190 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 20:28:07,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-08-25 20:28:07,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 20:28:07,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 20:28:07,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 20:28:07,550 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 20:28:07,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 20:28:07,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 21:12:51,797 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [596a13e7] Running command: LogoutUserCommand internal: false. >2014-08-25 21:12:51,807 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [596a13e7] Correlation ID: 596a13e7, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-25 21:24:56,209 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 21:28:07,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-08-25 21:28:07,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 21:28:07,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 21:28:07,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 21:28:07,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 21:28:07,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 21:28:07,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 22:23:25,172 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-25 22:28:07,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-08-25 22:28:07,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 22:28:07,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 22:28:07,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 22:28:07,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 22:28:07,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 22:28:07,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 23:28:07,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-08-25 23:28:07,581 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-25 23:28:07,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-25 23:28:07,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update template OVFs in Data Center Default_foobar >2014-08-25 23:28:07,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-25 23:28:07,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-25 23:28:07,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 00:28:07,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-08-26 00:28:07,589 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 00:28:07,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 00:28:07,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 00:28:07,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 00:28:07,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 00:28:07,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 01:28:07,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-08-26 01:28:07,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 01:28:07,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 01:28:07,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 01:28:07,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 01:28:07,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 01:28:07,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 02:28:07,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-08-26 02:28:07,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 02:28:07,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 02:28:07,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 02:28:07,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 02:28:07,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 02:28:07,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 02:40:43,490 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 03:28:07,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-08-26 03:28:07,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 03:28:07,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 03:28:07,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 03:28:07,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 03:28:07,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 03:28:07,617 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Start deleteAgedOutAuditLogs >2014-08-26 03:35:35,013 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Finished deleteAgedOutAuditLogs >2014-08-26 04:28:07,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-08-26 04:28:07,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 04:28:07,621 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 04:28:07,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 04:28:07,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 04:28:07,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 04:28:07,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 05:28:07,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-08-26 05:28:07,626 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 05:28:07,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 05:28:07,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 05:28:07,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 05:28:07,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 05:28:07,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 06:28:07,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-08-26 06:28:07,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 06:28:07,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 06:28:07,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 06:28:07,633 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 06:28:07,633 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 06:28:07,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 07:28:07,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-08-26 07:28:07,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 07:28:07,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 07:28:07,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 07:28:07,638 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 07:28:07,638 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 07:28:07,639 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 08:28:07,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-08-26 08:28:07,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 08:28:07,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 08:28:07,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 08:28:07,643 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 08:28:07,643 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 08:28:07,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 09:28:07,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-08-26 09:28:07,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 09:28:07,649 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 09:28:07,649 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 09:28:07,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 09:28:07,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 09:28:07,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 10:10:47,856 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginAdminUserCommand internal: false. >2014-08-26 10:10:47,866 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-26 10:10:47,931 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-08-26 10:10:47,932 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-6) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-08-26 10:10:48,320 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-10) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-08-26 10:11:29,993 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [a05b830] Lock Acquired to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-08-26 10:11:30,072 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [a05b830] Running command: UpdateVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-08-26 10:11:30,152 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [a05b830] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM no-os was renamed from no-os to dalsi. >2014-08-26 10:11:30,156 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [a05b830] Correlation ID: a05b830, Job ID: dadc1f22-e37d-41a8-a081-8c5edb95a240, Call Stack: null, Custom Event ID: -1, Message: VM no-os configuration was updated by admin. >2014-08-26 10:11:30,161 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-8) [a05b830] Lock freed to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-08-26 10:11:40,226 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-08-26 10:11:40,254 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] START, IsVmDuringInitiatingVDSCommand( vmId = a50e8ea6-38ce-4875-ae04-b0f4aff74534), log id: 1ac0af44 >2014-08-26 10:11:40,254 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1ac0af44 >2014-08-26 10:11:40,278 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] Running command: RunVmOnceCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-08-26 10:11:40,318 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] START, CreateVmVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 4536389c >2014-08-26 10:11:40,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] START, CreateVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 32d28f59 >2014-08-26 10:11:40,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=b6ef70ed-b5fe-438d-a047-ca774d97b650}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6e39ef6c-7c3e-4b35-8894-344fe08abdc4}, {shared=false, index=0, volumeID=59b771e5-a0d8-40ab-ba94-c10e44a82eec, propagateErrors=off, format=raw, type=disk, bootOrder=2, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=b4b4d9d0-e202-4a50-a3aa-520aed2fd057, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=b4b4d9d0-e202-4a50-a3aa-520aed2fd057}, {bootOrder=1, nicModel=pv, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0e, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=c294099f-e42c-4d67-b0a8-a168dd4db5fd}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=ad3cc5a1-0ab8-410d-8c77-ceb5ef8b38f9}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=4827014f-a8bd-4905-8b89-dd04b3462ed7}],acpiEnable=true,vmName=dalsi,cpuType=Westmere,custom={device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=6994543b-fefe-4319-a640-b72f5e5d39d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9e5b5092-be91-4262-85b4-acd2f0f67c6c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeed=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=2578113d-f2ac-477b-af54-ad9b824efeed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15device_9d578b03-14b3-4625-9edf-9e1522cb1260=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9d578b03-14b3-4625-9edf-9e1522cb1260, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=7a7cd09c-b3d5-44dd-827f-2978454d2a15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-08-26 10:11:40,388 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] FINISH, CreateVDSCommand, log id: 32d28f59 >2014-08-26 10:11:40,442 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 4536389c >2014-08-26 10:11:40,442 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-8) [125fb72c] Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-08-26 10:11:40,462 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [125fb72c] Correlation ID: 125fb72c, Job ID: c4fc8f46-880f-483c-b412-f161e69c856b, Call Stack: null, Custom Event ID: -1, Message: VM dalsi was started by admin (Host: slot-7.rhev.lab.eng.brq.redhat.com). >2014-08-26 10:11:42,310 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-62) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from WaitForLaunch --> PoweringUp >2014-08-26 10:11:42,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-62) START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 4b7a2958 >2014-08-26 10:11:42,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-62) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=6994543b-fefe-4319-a640-b72f5e5d39d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9e5b5092-be91-4262-85b4-acd2f0f67c6c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeed=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=2578113d-f2ac-477b-af54-ad9b824efeed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15device_9d578b03-14b3-4625-9edf-9e1522cb1260=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9d578b03-14b3-4625-9edf-9e1522cb1260, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=7a7cd09c-b3d5-44dd-827f-2978454d2a15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=12342, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@4130771e, vmName=dalsi, cpuType=Westmere}], log id: 4b7a2958 >2014-08-26 10:11:44,124 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [4567f7a2] Running command: SetVmTicketCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-08-26 10:11:44,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [4567f7a2] START, SetVmTicketVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, ticket=bNAOv+GspPG5, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: b9f95d >2014-08-26 10:11:44,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [4567f7a2] FINISH, SetVmTicketVDSCommand, log id: b9f95d >2014-08-26 10:11:44,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [4567f7a2] Correlation ID: 4567f7a2, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM dalsi >2014-08-26 10:11:51,478 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-99) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM dalsi. >2014-08-26 10:12:43,041 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from PoweringUp --> Up >2014-08-26 10:12:43,054 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-33) Correlation ID: 125fb72c, Job ID: c4fc8f46-880f-483c-b412-f161e69c856b, Call Stack: null, Custom Event ID: -1, Message: VM dalsi started on Host slot-7.rhev.lab.eng.brq.redhat.com >2014-08-26 10:12:43,058 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 10:19:22,474 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from Up --> RebootInProgress >2014-08-26 10:19:22,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-60) START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 57187689 >2014-08-26 10:19:22,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-60) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=6994543b-fefe-4319-a640-b72f5e5d39d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9e5b5092-be91-4262-85b4-acd2f0f67c6c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeed=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=2578113d-f2ac-477b-af54-ad9b824efeed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15device_9d578b03-14b3-4625-9edf-9e1522cb1260=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9d578b03-14b3-4625-9edf-9e1522cb1260, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=7a7cd09c-b3d5-44dd-827f-2978454d2a15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=12342, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@70e490b, vmName=dalsi, cpuType=Westmere}], log id: 57187689 >2014-08-26 10:20:17,089 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-96) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from RebootInProgress --> Up >2014-08-26 10:28:07,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-08-26 10:28:07,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 10:28:07,671 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-9) START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 917d5ac >2014-08-26 10:28:07,832 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, UpdateVMVDSCommand, log id: 917d5ac >2014-08-26 10:28:07,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 10:28:07,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 10:28:07,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 10:28:07,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 10:28:07,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 10:33:28,844 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [e0027fc] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >] >2014-08-26 10:33:28,866 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [e0027fc] Running command: AddDiskCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM, ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-26 10:33:28,932 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [752a8369] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: dd3c814d-9d43-46ff-8708-52dc8b452a97 Type: Storage >2014-08-26 10:33:28,944 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [752a8369] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >] >2014-08-26 10:33:28,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [752a8369] START, CreateImageVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = dfb71e18-fd2e-4957-9438-0d21d0d37fab, imageSizeInBytes = 5368709120, volumeFormat = RAW, newImageId = 9fc7a631-0a2d-4000-96d7-7d8080b8b091, newImageDescription = ), log id: 76713b7 >2014-08-26 10:33:28,945 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [752a8369] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-08-26 10:33:29,200 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [752a8369] FINISH, CreateImageVDSCommand, return: 9fc7a631-0a2d-4000-96d7-7d8080b8b091, log id: 76713b7 >2014-08-26 10:33:29,211 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-3) [752a8369] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command 80a1f185-c3a8-4e0c-beeb-bf7885cc5a44 >2014-08-26 10:33:29,211 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-3) [752a8369] CommandMultiAsyncTasks::AttachTask: Attaching task 6344c5bf-5370-4488-b8ce-3f71b769f40d to command 80a1f185-c3a8-4e0c-beeb-bf7885cc5a44. >2014-08-26 10:33:29,223 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-3) [752a8369] Adding task 6344c5bf-5370-4488-b8ce-3f71b769f40d (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-08-26 10:33:29,259 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [752a8369] Correlation ID: e0027fc, Job ID: 47d4683f-8106-48a4-9ca9-3130fa6ad51a, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of dalsi_Disk2 was initiated on VM dalsi by admin. >2014-08-26 10:33:29,259 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-3) [752a8369] BaseAsyncTask::startPollingTask: Starting to poll task 6344c5bf-5370-4488-b8ce-3f71b769f40d. >2014-08-26 10:33:30,625 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-77) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-08-26 10:33:30,634 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) SPMAsyncTask::PollTask: Polling task 6344c5bf-5370-4488-b8ce-3f71b769f40d (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-08-26 10:33:30,640 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-77) BaseAsyncTask::OnTaskEndSuccess: Task 6344c5bf-5370-4488-b8ce-3f71b769f40d (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-08-26 10:33:30,640 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::EndActionIfNecessary: All tasks of command 80a1f185-c3a8-4e0c-beeb-bf7885cc5a44 has ended -> executing endAction >2014-08-26 10:33:30,640 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-77) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: 80a1f185-c3a8-4e0c-beeb-bf7885cc5a44): calling endAction . >2014-08-26 10:33:30,641 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-33) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-08-26 10:33:30,651 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-33) [e0027fc] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-08-26 10:33:30,694 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-33) [6cc6394c] Lock Acquired to object EngineLock [exclusiveLocks= key: dfb71e18-fd2e-4957-9438-0d21d0d37fab value: DISK >, sharedLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >] >2014-08-26 10:33:30,792 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-33) [6cc6394c] Running command: HotPlugDiskToVmCommand internal: true. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-08-26 10:33:30,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-4-thread-33) [6cc6394c] START, HotPlugDiskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, diskId = dfb71e18-fd2e-4957-9438-0d21d0d37fab), log id: 5b436efe >2014-08-26 10:33:30,933 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-4-thread-33) [6cc6394c] FINISH, HotPlugDiskVDSCommand, log id: 5b436efe >2014-08-26 10:33:30,943 INFO [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-4-thread-33) [6cc6394c] Lock freed to object EngineLock [exclusiveLocks= key: dfb71e18-fd2e-4957-9438-0d21d0d37fab value: DISK >, sharedLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >] >2014-08-26 10:33:30,944 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-33) [752a8369] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-08-26 10:33:30,954 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-33) [752a8369] START, GetImageInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, imageGroupId = dfb71e18-fd2e-4957-9438-0d21d0d37fab, imageId = 9fc7a631-0a2d-4000-96d7-7d8080b8b091), log id: 2a8cec86 >2014-08-26 10:33:30,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-33) [752a8369] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@8e4672e4, log id: 2a8cec86 >2014-08-26 10:33:31,006 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) Correlation ID: e0027fc, Job ID: 47d4683f-8106-48a4-9ca9-3130fa6ad51a, Call Stack: null, Custom Event ID: -1, Message: The disk dalsi_Disk2 was successfully added to VM dalsi. >2014-08-26 10:33:31,006 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-33) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-08-26 10:33:31,007 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-33) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-08-26 10:33:31,010 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-33) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6344c5bf-5370-4488-b8ce-3f71b769f40d >2014-08-26 10:33:31,010 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-33) START, SPMClearTaskVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, taskId = 6344c5bf-5370-4488-b8ce-3f71b769f40d), log id: 55caef93 >2014-08-26 10:33:31,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-33) START, HSMClearTaskVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, taskId=6344c5bf-5370-4488-b8ce-3f71b769f40d), log id: 7e36c7e5 >2014-08-26 10:33:31,053 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-33) FINISH, HSMClearTaskVDSCommand, log id: 7e36c7e5 >2014-08-26 10:33:31,053 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-33) FINISH, SPMClearTaskVDSCommand, log id: 55caef93 >2014-08-26 10:33:31,056 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-33) BaseAsyncTask::RemoveTaskFromDB: Removed task 6344c5bf-5370-4488-b8ce-3f71b769f40d from DataBase >2014-08-26 10:33:31,056 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-33) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity 80a1f185-c3a8-4e0c-beeb-bf7885cc5a44 >2014-08-26 10:33:44,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) START, FullListVdsCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vds=Host[slot-7.rhev.lab.eng.brq.redhat.com,db0a9d36-feed-4855-9ea1-cfa0ccc52b0f], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 68689149 >2014-08-26 10:33:44,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-20) FINISH, FullListVdsCommand, return: [{displaySecurePort=5903, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=6994543b-fefe-4319-a640-b72f5e5d39d7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9e5b5092-be91-4262-85b4-acd2f0f67c6c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeed=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=2578113d-f2ac-477b-af54-ad9b824efeed, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15device_9d578b03-14b3-4625-9edf-9e1522cb1260=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9d578b03-14b3-4625-9edf-9e1522cb1260, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_9e5b5092-be91-4262-85b4-acd2f0f67c6cdevice_6994543b-fefe-4319-a640-b72f5e5d39d7device_2578113d-f2ac-477b-af54-ad9b824efeeddevice_7a7cd09c-b3d5-44dd-827f-2978454d2a15=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=7a7cd09c-b3d5-44dd-827f-2978454d2a15, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5902, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=12342, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.130.128, devices=[Ljava.lang.Object;@291a852c, vmName=dalsi, cpuType=Westmere}], log id: 68689149 >2014-08-26 10:34:37,669 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) Setting new tasks map. The map contains now 0 tasks >2014-08-26 10:34:37,669 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-14) Cleared all tasks of pool 00000002-0002-0002-0002-000000000135. >2014-08-26 10:36:31,361 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 10:36:44,633 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-08-26 10:36:44,636 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-08-26 10:40:48,918 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 11:00:59,096 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-53) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal got disconnected from VM dalsi. >2014-08-26 11:28:07,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-08-26 11:28:07,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 11:28:07,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-12) START, UpdateVMVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 61c0abbc >2014-08-26 11:28:07,955 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, UpdateVMVDSCommand, log id: 61c0abbc >2014-08-26 11:28:07,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 11:28:07,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 11:28:07,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 11:28:07,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 11:28:07,961 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 12:28:07,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-08-26 12:28:07,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 12:28:07,965 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 12:28:07,965 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 12:28:07,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 12:28:07,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 12:28:07,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 12:34:01,339 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 12:41:11,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-40) START, DestroyVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: 5e2340ec >2014-08-26 12:41:11,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, DestroyVDSCommand, log id: 5e2340ec >2014-08-26 12:41:11,180 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM dalsi is down. Exit message: User shut down >2014-08-26 12:41:11,183 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-40) VM dalsi (a50e8ea6-38ce-4875-ae04-b0f4aff74534) is running in db and not running in VDS slot-7.rhev.lab.eng.brq.redhat.com >2014-08-26 12:41:11,198 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-22) [7cd7778a] Running command: ProcessDownVmCommand internal: true. >2014-08-26 13:28:07,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-08-26 13:28:07,971 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 13:28:07,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 13:28:07,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 13:28:07,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 13:28:07,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 13:28:07,974 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 13:38:47,636 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 14:03:14,382 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 14:11:03,107 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 14:27:11,217 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 14:28:07,974 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-08-26 14:28:07,976 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 14:28:07,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 14:28:07,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 14:28:07,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 14:28:07,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 14:28:07,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 15:28:07,980 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-08-26 15:28:07,982 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 15:28:07,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 15:28:07,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 15:28:07,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 15:28:07,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 15:28:07,985 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 16:28:07,986 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-08-26 16:28:07,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 16:28:07,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 16:28:07,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 16:28:07,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 16:28:07,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 16:28:07,991 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 17:28:07,992 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-08-26 17:28:07,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 17:28:08,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 17:28:08,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 17:28:08,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 17:28:08,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 17:28:08,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 17:31:08,516 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 17:33:24,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 17:46:46,214 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 17:58:37,263 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 18:28:08,006 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-08-26 18:28:08,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 18:28:08,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 18:28:08,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 18:28:08,010 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 18:28:08,011 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 18:28:08,011 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 19:13:12,234 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 19:28:08,012 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-08-26 19:28:08,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 19:28:08,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 19:28:08,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 19:28:08,016 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 19:28:08,016 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 19:28:08,018 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 19:51:00,927 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 20:28:08,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-08-26 20:28:08,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 20:28:08,021 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 20:28:08,021 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 20:28:08,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 20:28:08,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 20:28:08,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 20:46:27,626 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 21:28:08,028 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-08-26 21:28:08,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 21:28:08,030 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 21:28:08,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 21:28:08,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 21:28:08,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 21:28:08,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 21:58:01,807 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 22:20:42,504 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 22:28:08,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-08-26 22:28:08,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 22:28:08,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 22:28:08,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 22:28:08,037 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 22:28:08,038 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 22:28:08,038 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 22:41:52,378 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-26 23:28:08,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-08-26 23:28:08,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-26 23:28:08,043 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-26 23:28:08,043 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-08-26 23:28:08,044 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-26 23:28:08,044 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-26 23:28:08,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 00:28:08,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-08-27 00:28:08,047 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 00:28:08,048 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 00:28:08,048 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 00:28:08,049 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 00:28:08,049 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 00:28:08,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 00:33:15,309 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 00:54:25,361 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 01:28:08,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-08-27 01:28:08,053 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 01:28:08,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 01:28:08,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 01:28:08,055 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 01:28:08,055 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 01:28:08,056 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 01:42:33,828 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 02:01:42,756 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 02:28:08,057 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-08-27 02:28:08,058 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 02:28:08,059 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 02:28:08,060 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 02:28:08,061 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 02:28:08,061 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 02:28:08,062 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 03:23:09,893 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 03:28:08,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-08-27 03:28:08,064 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 03:28:08,066 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 03:28:08,066 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 03:28:08,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 03:28:08,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 03:28:08,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-52) Start deleteAgedOutAuditLogs >2014-08-27 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-52) Finished deleteAgedOutAuditLogs >2014-08-27 03:51:04,969 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 04:28:08,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-08-27 04:28:08,070 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 04:28:08,071 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 04:28:08,071 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 04:28:08,073 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 04:28:08,073 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 04:28:08,074 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 05:04:55,549 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 05:16:31,267 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 05:22:34,042 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 05:28:08,075 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-08-27 05:28:08,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 05:28:08,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 05:28:08,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 05:28:08,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 05:28:08,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 05:28:08,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 05:46:30,317 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 06:28:08,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-08-27 06:28:08,080 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 06:28:08,081 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 06:28:08,081 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 06:28:08,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 06:28:08,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 06:28:08,083 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 06:57:49,285 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 07:28:08,084 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-08-27 07:28:08,085 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 07:28:08,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 07:28:08,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 07:28:08,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 07:28:08,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 07:28:08,089 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 07:44:56,248 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 08:28:08,090 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-08-27 08:28:08,091 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 08:28:08,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 08:28:08,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 08:28:08,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 08:28:08,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 08:28:08,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 09:19:39,585 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-10) [5c3ac5e9] Running command: LogoutUserCommand internal: false. >2014-08-27 09:19:39,594 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [5c3ac5e9] Correlation ID: 5c3ac5e9, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-08-27 09:28:08,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-08-27 09:28:08,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 09:28:08,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 09:28:08,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 09:28:08,099 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 09:28:08,100 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 09:28:08,101 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 09:56:43,733 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 10:07:18,856 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 10:14:52,373 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 10:28:08,102 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-08-27 10:28:08,103 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 10:28:08,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 10:28:08,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 10:28:08,105 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 10:28:08,105 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 10:28:08,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 11:28:08,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-08-27 11:28:08,108 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 11:28:08,109 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 11:28:08,109 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 11:28:08,110 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 11:28:08,110 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 11:28:08,111 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 11:57:26,233 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 12:02:58,959 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 12:28:08,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-08-27 12:28:08,113 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 12:28:08,116 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 12:28:08,116 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 12:28:08,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 12:28:08,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 12:28:08,118 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 13:24:22,145 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 13:25:22,596 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 13:28:08,119 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-08-27 13:28:08,120 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 13:28:08,121 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 13:28:08,121 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 13:28:08,122 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 13:28:08,122 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 13:28:08,124 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 14:26:36,437 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 14:28:08,125 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-08-27 14:28:08,126 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 14:28:08,127 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 14:28:08,127 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 14:28:08,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 14:28:08,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 14:28:08,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 14:52:48,897 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 15:13:13,643 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 15:28:08,130 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-08-27 15:28:08,131 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 15:28:08,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 15:28:08,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 15:28:08,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 15:28:08,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 15:28:08,134 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 15:39:56,238 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 15:43:42,939 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 16:12:12,185 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 16:28:08,135 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-08-27 16:28:08,136 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 16:28:08,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 16:28:08,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 16:28:08,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 16:28:08,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 16:28:08,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 17:14:42,483 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 17:28:08,140 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-08-27 17:28:08,141 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 17:28:08,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 17:28:08,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 17:28:08,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 17:28:08,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 17:28:08,145 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 17:41:25,117 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 18:28:08,146 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-08-27 18:28:08,147 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 18:28:08,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 18:28:08,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 18:28:08,150 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 18:28:08,150 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 18:28:08,151 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 19:28:08,152 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-08-27 19:28:08,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 19:28:08,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 19:28:08,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 19:28:08,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 19:28:08,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 19:28:08,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 19:55:29,625 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 20:28:08,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-08-27 20:28:08,157 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 20:28:08,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 20:28:08,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 20:28:08,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 20:28:08,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 20:28:08,160 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 21:23:41,924 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-27 21:28:08,161 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-08-27 21:28:08,162 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 21:28:08,163 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 21:28:08,163 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 21:28:08,164 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 21:28:08,164 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 21:28:08,165 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 22:28:08,166 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-08-27 22:28:08,168 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 22:28:08,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 22:28:08,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 22:28:08,170 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 22:28:08,170 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 22:28:08,171 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 23:28:08,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-08-27 23:28:08,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-27 23:28:08,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-27 23:28:08,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update template OVFs in Data Center Default_foobar >2014-08-27 23:28:08,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-27 23:28:08,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-27 23:28:08,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 00:08:45,844 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 00:28:08,178 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-08-28 00:28:08,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 00:28:08,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 00:28:08,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 00:28:08,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 00:28:08,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 00:28:08,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 01:28:08,185 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-08-28 01:28:08,186 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 01:28:08,187 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 01:28:08,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 01:28:08,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 01:28:08,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 01:28:08,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 02:28:08,190 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VMs/Templates Ovf. >2014-08-28 02:28:08,191 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 02:28:08,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 02:28:08,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 02:28:08,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 02:28:08,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 02:28:08,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 02:53:33,866 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 02:54:04,184 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 03:28:08,197 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-08-28 03:28:08,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 03:28:08,199 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 03:28:08,199 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 03:28:08,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 03:28:08,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 03:28:08,201 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 03:32:07,059 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-50) Start deleteAgedOutAuditLogs >2014-08-28 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-50) Finished deleteAgedOutAuditLogs >2014-08-28 04:28:08,202 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-08-28 04:28:08,203 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 04:28:08,204 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 04:28:08,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 04:28:08,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 04:28:08,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 04:28:08,206 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 04:30:22,990 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 04:37:08,219 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 04:43:26,207 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 05:26:01,964 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 05:28:08,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-08-28 05:28:08,208 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 05:28:08,209 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 05:28:08,209 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 05:28:08,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 05:28:08,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 05:28:08,211 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 06:06:21,636 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 06:10:53,708 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 06:16:56,571 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 06:22:29,418 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 06:28:08,213 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-08-28 06:28:08,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 06:28:08,215 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 06:28:08,215 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 06:28:08,216 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 06:28:08,216 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 06:28:08,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 07:28:08,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-08-28 07:28:08,219 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 07:28:08,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 07:28:08,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 07:28:08,221 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 07:28:08,221 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 07:28:08,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 07:54:58,549 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 08:28:08,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-08-28 08:28:08,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 08:28:08,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 08:28:08,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 08:28:08,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 08:28:08,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 08:28:08,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 08:50:40,425 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 09:02:15,833 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 09:28:08,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-08-28 09:28:08,229 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 09:28:08,230 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 09:28:08,230 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 09:28:08,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 09:28:08,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 09:28:08,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 10:07:16,113 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 10:28:08,234 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-08-28 10:28:08,235 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 10:28:08,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 10:28:08,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 10:28:08,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 10:28:08,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 10:28:08,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 10:52:22,446 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 11:28:08,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-08-28 11:28:08,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 11:28:08,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 11:28:08,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 11:28:08,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 11:28:08,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 11:28:08,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 12:00:09,227 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 12:28:08,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-08-28 12:28:08,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 12:28:08,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 12:28:08,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 12:28:08,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 12:28:08,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 12:28:08,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 12:34:40,798 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 13:08:57,509 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 13:28:08,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-08-28 13:28:08,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 13:28:08,251 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 13:28:08,251 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 13:28:08,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 13:28:08,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 13:28:08,254 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 13:29:07,124 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 13:37:11,082 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 13:58:36,309 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 14:28:08,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VMs/Templates Ovf. >2014-08-28 14:28:08,256 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 14:28:08,257 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 14:28:08,257 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 14:28:08,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 14:28:08,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 14:28:08,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 15:01:05,874 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 15:28:08,260 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-08-28 15:28:08,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 15:28:08,264 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 15:28:08,264 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 15:28:08,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 15:28:08,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 15:28:08,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 15:51:15,133 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 16:28:08,266 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-08-28 16:28:08,268 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 16:28:08,269 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 16:28:08,269 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 16:28:08,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 16:28:08,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 16:28:08,271 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 16:44:11,093 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 17:28:08,272 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-08-28 17:28:08,274 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 17:28:08,275 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 17:28:08,275 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 17:28:08,276 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 17:28:08,276 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 17:28:08,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 17:49:41,925 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 18:07:50,425 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 18:28:08,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-08-28 18:28:08,279 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 18:28:08,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 18:28:08,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 18:28:08,281 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 18:28:08,281 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 18:28:08,282 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 18:37:19,260 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 18:38:04,595 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 18:51:11,100 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 18:58:59,664 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 19:27:28,498 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 19:28:08,283 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-08-28 19:28:08,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 19:28:08,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 19:28:08,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 19:28:08,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 19:28:08,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 19:28:08,288 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 19:54:11,196 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 20:06:01,694 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 20:07:17,286 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 20:21:24,095 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 20:28:08,289 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-08-28 20:28:08,290 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 20:28:08,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 20:28:08,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 20:28:08,292 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 20:28:08,292 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 20:28:08,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 20:49:07,289 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 21:03:44,242 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 21:11:18,113 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 21:28:08,303 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-08-28 21:28:08,305 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 21:28:08,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 21:28:08,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 21:28:08,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 21:28:08,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 21:28:08,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 22:03:57,885 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 22:07:59,735 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 22:28:08,308 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-08-28 22:28:08,309 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 22:28:08,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 22:28:08,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 22:28:08,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 22:28:08,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 22:28:08,313 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 22:34:27,183 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 22:41:30,455 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-28 23:28:08,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-08-28 23:28:08,315 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-28 23:28:08,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-28 23:28:08,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center Default_foobar >2014-08-28 23:28:08,317 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-28 23:28:08,318 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-28 23:28:08,319 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 00:01:38,610 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 00:28:08,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-08-29 00:28:08,321 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 00:28:08,323 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 00:28:08,323 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 00:28:08,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 00:28:08,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 00:28:08,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 01:03:53,526 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 01:28:08,326 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-08-29 01:28:08,327 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 01:28:08,328 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 01:28:08,328 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 01:28:08,329 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 01:28:08,329 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 01:28:08,330 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 02:05:38,177 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 02:28:08,331 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-08-29 02:28:08,332 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 02:28:08,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 02:28:08,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 02:28:08,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 02:28:08,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 02:28:08,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 03:28:08,336 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-08-29 03:28:08,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 03:28:08,339 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 03:28:08,339 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 03:28:08,340 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 03:28:08,340 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 03:28:08,347 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-91) Start deleteAgedOutAuditLogs >2014-08-29 03:35:35,007 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-91) Finished deleteAgedOutAuditLogs >2014-08-29 04:17:25,775 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 04:28:08,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-08-29 04:28:08,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 04:28:08,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 04:28:08,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 04:28:08,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 04:28:08,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 04:28:08,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 04:49:40,969 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 04:53:42,856 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 04:57:29,644 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 05:11:21,230 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 05:28:08,356 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-08-29 05:28:08,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 05:28:08,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 05:28:08,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 05:28:08,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 05:28:08,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 05:28:08,361 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 05:35:02,512 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 06:03:16,457 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 06:28:08,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-08-29 06:28:08,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 06:28:08,365 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 06:28:08,365 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 06:28:08,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 06:28:08,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 06:28:08,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 06:32:30,666 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 07:02:44,823 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 07:28:08,368 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-08-29 07:28:08,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 07:28:08,370 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 07:28:08,370 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 07:28:08,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 07:28:08,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 07:28:08,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 07:54:24,508 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 07:56:40,736 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 08:13:34,146 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 08:28:08,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-08-29 08:28:08,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 08:28:08,375 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 08:28:08,375 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 08:28:08,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 08:28:08,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 08:28:08,377 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 09:11:32,207 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 09:28:08,378 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-08-29 09:28:08,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 09:28:08,381 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 09:28:08,381 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 09:28:08,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 09:28:08,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 09:28:08,383 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 10:01:11,338 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 10:21:05,893 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 10:28:08,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-08-29 10:28:08,385 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 10:28:08,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 10:28:08,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 10:28:08,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 10:28:08,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 10:28:08,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 10:43:31,377 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 10:53:36,226 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 11:22:50,049 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 11:28:08,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-08-29 11:28:08,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 11:28:08,392 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 11:28:08,392 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 11:28:08,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 11:28:08,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 11:28:08,394 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 11:29:53,525 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 12:28:08,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-08-29 12:28:08,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 12:28:08,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 12:28:08,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 12:28:08,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 12:28:08,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 12:28:08,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 12:40:27,537 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 13:28:08,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-08-29 13:28:08,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 13:28:08,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 13:28:08,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 13:28:08,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 13:28:08,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 13:28:08,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 13:44:28,685 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 14:28:08,407 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-08-29 14:28:08,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 14:28:08,409 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 14:28:08,409 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 14:28:08,410 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 14:28:08,410 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 14:28:08,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 15:28:08,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-08-29 15:28:08,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 15:28:08,414 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 15:28:08,414 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 15:28:08,415 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 15:28:08,415 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 15:28:08,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 15:58:33,138 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 16:28:08,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-08-29 16:28:08,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 16:28:08,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 16:28:08,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 16:28:08,420 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 16:28:08,420 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 16:28:08,421 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 16:41:23,231 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 17:28:08,422 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-08-29 17:28:08,423 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 17:28:08,424 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 17:28:08,424 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 17:28:08,425 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 17:28:08,426 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 17:28:08,427 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 18:07:49,449 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 18:24:42,716 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 18:28:08,428 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-08-29 18:28:08,429 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 18:28:08,430 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 18:28:08,430 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 18:28:08,431 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 18:28:08,431 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 18:28:08,432 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 18:54:57,469 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 19:28:08,432 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-08-29 19:28:08,433 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 19:28:08,434 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 19:28:08,434 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 19:28:08,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 19:28:08,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 19:28:08,436 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 19:45:21,720 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 20:28:08,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-08-29 20:28:08,438 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 20:28:08,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 20:28:08,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 20:28:08,440 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 20:28:08,440 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 20:28:08,441 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 20:42:03,537 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 21:28:08,442 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-08-29 21:28:08,443 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 21:28:08,444 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 21:28:08,444 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 21:28:08,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 21:28:08,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 21:28:08,446 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 21:53:01,532 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 21:53:37,826 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 22:16:48,917 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 22:28:08,447 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-08-29 22:28:08,448 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 22:28:08,450 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 22:28:08,450 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 22:28:08,451 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 22:28:08,451 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 22:28:08,452 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 22:30:40,653 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 23:19:18,862 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 23:26:52,603 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-29 23:28:08,453 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-08-29 23:28:08,454 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-29 23:28:08,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-29 23:28:08,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update template OVFs in Data Center Default_foobar >2014-08-29 23:28:08,456 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-29 23:28:08,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 23:28:08,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-29 23:47:32,358 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 00:13:59,775 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 00:28:08,458 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-08-30 00:28:08,460 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 00:28:08,461 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 00:28:08,461 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 00:28:08,462 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 00:28:08,462 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 00:28:08,463 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 00:46:44,920 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 01:18:00,193 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 01:28:08,464 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-08-30 01:28:08,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 01:28:08,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 01:28:08,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 01:28:08,468 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 01:28:08,468 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 01:28:08,469 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 01:28:35,093 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 02:28:08,470 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-08-30 02:28:08,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 02:28:08,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 02:28:08,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 02:28:08,473 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 02:28:08,473 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 02:28:08,474 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 02:55:31,535 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 03:28:08,475 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update VMs/Templates Ovf. >2014-08-30 03:28:08,477 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 03:28:08,478 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 03:28:08,478 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 03:28:08,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 03:28:08,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 03:28:08,480 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-89) Start deleteAgedOutAuditLogs >2014-08-30 03:35:35,015 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-89) Finished deleteAgedOutAuditLogs >2014-08-30 03:36:05,884 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 03:50:27,746 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 04:21:42,727 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 04:28:08,481 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-08-30 04:28:08,483 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 04:28:08,484 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 04:28:08,484 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 04:28:08,485 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 04:28:08,485 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 04:28:08,486 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 05:28:08,486 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-08-30 05:28:08,487 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 05:28:08,489 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 05:28:08,489 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 05:28:08,490 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 05:28:08,490 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 05:28:08,490 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 05:31:45,406 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 06:28:08,491 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-08-30 06:28:08,492 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 06:28:08,493 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 06:28:08,493 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 06:28:08,494 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 06:28:08,494 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 06:28:08,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 07:12:33,288 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 07:28:08,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-08-30 07:28:08,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 07:28:08,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 07:28:08,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 07:28:08,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 07:28:08,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 07:28:08,500 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 08:28:08,501 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-08-30 08:28:08,502 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 08:28:08,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 08:28:08,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 08:28:08,504 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 08:28:08,504 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 08:28:08,505 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 09:26:37,322 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 09:28:08,506 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-08-30 09:28:08,507 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 09:28:08,508 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 09:28:08,509 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 09:28:08,510 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 09:28:08,510 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 09:28:08,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 10:28:08,512 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-08-30 10:28:08,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 10:28:08,515 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 10:28:08,515 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 10:28:08,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 10:28:08,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 10:28:08,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 11:22:02,993 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 11:28:08,518 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-08-30 11:28:08,519 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 11:28:08,520 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 11:28:08,521 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 11:28:08,521 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 11:28:08,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 11:28:08,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 11:37:55,428 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 11:41:11,977 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 12:28:08,524 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-08-30 12:28:08,525 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 12:28:08,527 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 12:28:08,527 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 12:28:08,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 12:28:08,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 12:28:08,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 12:57:03,323 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 13:00:19,908 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 13:28:08,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-08-30 13:28:08,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 13:28:08,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 13:28:08,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 13:28:08,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 13:28:08,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 13:28:08,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 13:43:40,196 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 14:28:01,125 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 14:28:08,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-08-30 14:28:08,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 14:28:08,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 14:28:08,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 14:28:08,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 14:28:08,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 14:28:08,539 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 15:28:08,539 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-08-30 15:28:08,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 15:28:08,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 15:28:08,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 15:28:08,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 15:28:08,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 15:28:08,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 16:07:18,260 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 16:10:49,940 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 16:28:08,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-08-30 16:28:08,544 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 16:28:08,545 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 16:28:08,545 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 16:28:08,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 16:28:08,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 16:28:08,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 16:47:37,476 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 16:59:43,581 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 17:28:08,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-08-30 17:28:08,550 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 17:28:08,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 17:28:08,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 17:28:08,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 17:28:08,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 17:28:08,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 18:11:33,913 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 18:15:20,800 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 18:17:21,723 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 18:28:08,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-08-30 18:28:08,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 18:28:08,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 18:28:08,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 18:28:08,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 18:28:08,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 18:28:08,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 18:34:14,719 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 18:45:04,864 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 18:53:08,767 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 19:00:57,546 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 19:28:08,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-08-30 19:28:08,560 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 19:28:08,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 19:28:08,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 19:28:08,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 19:28:08,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 19:28:08,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 19:53:07,422 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 20:06:43,721 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 20:28:08,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-08-30 20:28:08,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 20:28:08,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 20:28:08,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 20:28:08,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 20:28:08,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 20:28:08,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 21:28:08,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-08-30 21:28:08,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 21:28:08,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 21:28:08,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 21:28:08,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 21:28:08,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 21:28:08,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 21:47:32,469 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 22:02:54,753 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 22:03:25,000 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 22:06:56,606 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 22:28:08,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-08-30 22:28:08,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 22:28:08,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 22:28:08,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 22:28:08,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 22:28:08,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 22:28:08,578 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 22:28:21,773 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-30 23:28:08,578 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-08-30 23:28:08,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-30 23:28:08,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-30 23:28:08,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update template OVFs in Data Center Default_foobar >2014-08-30 23:28:08,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-30 23:28:08,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-30 23:28:08,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 00:04:52,200 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 00:25:17,071 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 00:28:08,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-08-31 00:28:08,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 00:28:08,590 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 00:28:08,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 00:28:08,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 00:28:08,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 00:28:08,593 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 01:01:49,674 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 01:28:08,593 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-08-31 01:28:08,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 01:28:08,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 01:28:08,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 01:28:08,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 01:28:08,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 01:28:08,598 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 01:33:34,992 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 02:23:28,834 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 02:28:08,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-08-31 02:28:08,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 02:28:08,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 02:28:08,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 02:28:08,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 02:28:08,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 02:28:08,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 02:45:09,030 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 03:28:08,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-08-31 03:28:08,605 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 03:28:08,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 03:28:08,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 03:28:08,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 03:28:08,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 03:28:08,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-65) Start deleteAgedOutAuditLogs >2014-08-31 03:35:35,010 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-65) Finished deleteAgedOutAuditLogs >2014-08-31 03:39:49,551 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 03:53:56,392 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 03:57:58,261 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 04:22:40,201 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 04:24:26,122 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 04:28:08,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-08-31 04:28:08,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 04:28:08,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 04:28:08,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 04:28:08,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 04:28:08,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 04:28:08,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 04:34:15,706 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 04:44:20,547 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 05:06:31,040 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 05:26:41,000 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 05:28:08,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-08-31 05:28:08,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 05:28:08,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 05:28:08,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 05:28:08,614 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 05:28:08,614 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 05:28:08,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 06:15:04,244 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 06:28:08,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-08-31 06:28:08,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 06:28:08,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 06:28:08,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 06:28:08,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 06:28:08,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 06:28:08,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 07:28:08,621 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-08-31 07:28:08,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 07:28:08,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 07:28:08,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 07:28:08,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 07:28:08,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 07:28:08,625 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 08:14:30,738 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 08:28:08,626 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-08-31 08:28:08,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 08:28:08,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 08:28:08,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 08:28:08,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 08:28:08,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 08:28:08,630 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 09:28:08,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-08-31 09:28:08,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 09:28:08,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 09:28:08,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 09:28:08,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 09:28:08,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 09:28:08,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 10:22:32,433 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 10:28:08,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-08-31 10:28:08,639 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 10:28:08,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 10:28:08,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 10:28:08,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 10:28:08,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 10:28:08,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 11:28:08,643 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-08-31 11:28:08,644 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 11:28:08,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 11:28:08,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 11:28:08,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 11:28:08,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 11:28:08,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 12:28:08,648 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-08-31 12:28:08,649 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 12:28:08,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 12:28:08,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 12:28:08,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 12:28:08,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 12:28:08,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 12:44:24,414 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 13:28:08,654 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-08-31 13:28:08,655 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 13:28:08,656 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 13:28:08,656 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 13:28:08,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 13:28:08,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 13:28:08,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 13:35:49,080 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 14:19:24,861 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 14:28:08,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-08-31 14:28:08,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 14:28:08,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 14:28:08,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 14:28:08,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 14:28:08,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 14:28:08,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 14:35:47,663 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 14:46:23,066 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 14:46:38,219 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 15:28:08,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-08-31 15:28:08,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 15:28:08,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 15:28:08,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 15:28:08,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 15:28:08,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 15:28:08,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 15:38:15,359 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 15:50:08,957 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 15:53:55,790 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 16:21:23,778 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 16:28:08,669 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-08-31 16:28:08,670 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 16:28:08,671 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 16:28:08,671 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 16:28:08,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 16:28:08,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 16:28:08,673 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 17:00:27,166 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 17:28:08,674 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-08-31 17:28:08,675 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 17:28:08,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 17:28:08,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 17:28:08,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 17:28:08,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 17:28:08,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 17:28:55,562 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 17:51:06,036 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 18:28:08,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-08-31 18:28:08,680 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 18:28:08,681 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 18:28:08,681 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 18:28:08,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 18:28:08,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 18:28:08,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 19:20:49,750 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 19:28:08,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-08-31 19:28:08,685 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 19:28:08,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 19:28:08,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 19:28:08,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 19:28:08,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 19:28:08,688 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 20:14:15,343 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 20:28:08,688 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-08-31 20:28:08,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 20:28:08,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 20:28:08,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 20:28:08,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 20:28:08,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 20:28:08,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 20:35:10,333 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 21:28:08,694 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-08-31 21:28:08,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 21:28:08,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 21:28:08,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 21:28:08,698 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 21:28:08,698 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 21:28:08,699 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 22:27:05,565 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-08-31 22:28:08,701 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-08-31 22:28:08,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 22:28:08,703 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 22:28:08,703 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 22:28:08,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 22:28:08,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 22:28:08,705 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 23:28:08,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-08-31 23:28:08,707 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-08-31 23:28:08,708 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-08-31 23:28:08,708 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-08-31 23:28:08,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-08-31 23:28:08,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-08-31 23:28:08,710 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 00:28:08,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-01 00:28:08,712 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 00:28:08,713 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 00:28:08,713 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 00:28:08,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 00:28:08,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 00:28:08,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 00:34:22,551 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 00:44:12,152 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 01:28:08,716 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-01 01:28:08,717 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 01:28:08,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 01:28:08,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 01:28:08,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 01:28:08,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 01:28:08,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 01:37:52,609 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 02:03:49,875 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 02:28:08,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-01 02:28:08,722 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 02:28:08,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 02:28:08,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 02:28:08,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 02:28:08,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 02:28:08,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 02:40:37,631 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 02:47:41,110 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 03:23:52,162 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 03:28:08,726 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-01 03:28:08,728 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 03:28:08,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 03:28:08,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 03:28:08,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 03:28:08,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 03:28:08,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-80) Start deleteAgedOutAuditLogs >2014-09-01 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-80) Finished deleteAgedOutAuditLogs >2014-09-01 04:20:55,358 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 04:28:08,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-09-01 04:28:08,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 04:28:08,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 04:28:08,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 04:28:08,735 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 04:28:08,735 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 04:28:08,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 05:26:42,206 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 05:28:08,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-09-01 05:28:08,738 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 05:28:08,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 05:28:08,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 05:28:08,740 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 05:28:08,740 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 05:28:08,741 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 05:35:16,406 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 05:48:07,549 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 05:50:08,552 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 06:13:34,451 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 06:18:51,984 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 06:25:25,077 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 06:28:08,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-01 06:28:08,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 06:28:08,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 06:28:08,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 06:28:08,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 06:28:08,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 06:28:08,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 07:28:08,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-01 07:28:08,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 07:28:08,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 07:28:08,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 07:28:08,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 07:28:08,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 07:28:08,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 07:50:20,705 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 07:52:21,639 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 08:13:16,320 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 08:28:08,756 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VMs/Templates Ovf. >2014-09-01 08:28:08,757 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 08:28:08,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 08:28:08,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 08:28:08,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 08:28:08,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 08:28:08,761 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 08:38:28,226 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 08:39:28,849 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 09:28:08,762 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-01 09:28:08,763 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 09:28:08,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 09:28:08,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 09:28:08,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 09:28:08,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 09:28:08,766 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 10:03:38,955 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 10:22:02,574 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 10:28:08,767 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-01 10:28:08,768 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 10:28:08,769 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 10:28:08,769 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 10:28:08,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 10:28:08,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 10:28:08,771 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 11:25:32,992 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 11:28:08,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-01 11:28:08,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 11:28:08,774 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 11:28:08,774 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 11:28:08,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 11:28:08,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 11:28:08,777 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 11:36:38,114 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 11:41:40,424 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 11:45:27,253 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 12:05:37,073 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 12:28:08,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-01 12:28:08,779 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 12:28:08,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 12:28:08,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 12:28:08,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 12:28:08,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 12:28:08,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 13:23:44,240 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 13:24:44,712 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 13:28:08,783 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-01 13:28:08,784 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 13:28:08,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 13:28:08,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 13:28:08,786 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 13:28:08,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 13:28:08,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 14:02:47,725 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 14:06:19,361 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 14:28:08,788 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-01 14:28:08,789 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 14:28:08,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 14:28:08,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 14:28:08,791 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 14:28:08,791 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 14:28:08,792 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 15:04:22,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Warning, Low disk space.n2_foo_bar domain has 39 GB of free space >2014-09-01 15:06:02,083 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 15:07:47,915 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 15:14:51,226 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 15:28:08,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-01 15:28:08,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 15:28:08,796 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 15:28:08,796 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 15:28:08,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 15:28:08,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 15:28:08,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 15:28:36,605 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-7) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/Administration_Guide/Red_Hat_Enterprise_Virtualization-3.4-Administration_Guide.pdf is 6834410 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 15:28:42,519 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-6) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/Administration_Guide/Red_Hat_Enterprise_Virtualization-3.4-Administration_Guide.pdf is 6834410 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 15:29:09,066 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-9) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/Installation_Guide/Red_Hat_Enterprise_Virtualization-3.4-Installation_Guide.pdf is 2426254 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 15:29:15,304 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-4) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/Technical_Guide/Red_Hat_Enterprise_Virtualization-3.4-Technical_Guide.pdf is 3397384 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 15:29:19,430 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-2) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/User_Guide/Red_Hat_Enterprise_Virtualization-3.4-User_Guide.pdf is 2189571 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 15:31:09,548 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginUserCommand internal: false. >2014-09-01 15:31:09,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-01 15:31:09,583 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-11) [5bcf1582] Running command: LogoutUserCommand internal: false. >2014-09-01 15:31:09,589 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [5bcf1582] Correlation ID: 5bcf1582, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-09-01 15:33:44,901 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 15:43:55,812 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-11) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,347 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-2) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,350 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-5) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,356 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-6) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,367 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-9) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,368 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-4) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,369 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-10) Detected Locale is null, setting to default: en_US >2014-09-01 15:43:56,382 WARN [org.ovirt.engine.core.branding.BrandingFilter] (ajp-/127.0.0.1:8702-7) Detected Locale is null, setting to default: en_US >2014-09-01 15:55:10,490 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 16:08:16,723 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 16:20:37,818 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 16:28:08,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-01 16:28:08,800 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 16:28:08,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 16:28:08,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 16:28:08,802 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 16:28:08,802 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 16:28:08,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 16:36:45,376 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 16:41:47,837 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 16:44:42,708 WARN [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-10) File "/usr/share/doc/rhevm-doc/manual/en-US/pdf/Installation_Guide/Red_Hat_Enterprise_Virtualization-3.4-Installation_Guide.pdf is 2426254 bytes long. Please reconsider using this servlet for files larger than 1048576 bytes. >2014-09-01 17:28:08,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-01 17:28:08,806 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 17:28:08,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 17:28:08,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 17:28:08,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 17:28:08,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 17:28:08,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 18:13:16,311 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 18:28:08,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-01 18:28:08,810 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 18:28:08,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 18:28:08,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 18:28:08,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 18:28:08,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 18:28:08,813 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 18:55:37,567 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 19:28:08,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-09-01 19:28:08,815 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 19:28:08,817 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 19:28:08,817 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 19:28:08,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 19:28:08,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 19:28:08,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 20:25:50,816 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 20:28:08,820 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-01 20:28:08,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 20:28:08,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 20:28:08,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 20:28:08,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 20:28:08,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 20:28:08,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 21:11:28,462 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 21:17:16,142 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 21:28:08,825 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-09-01 21:28:08,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 21:28:08,827 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 21:28:08,827 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 21:28:08,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 21:28:08,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 21:28:08,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 21:36:55,686 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 21:42:43,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 22:28:08,830 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-01 22:28:08,831 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 22:28:08,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 22:28:08,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 22:28:08,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 22:28:08,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 22:28:08,834 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 22:29:51,459 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 22:57:49,741 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 22:59:50,673 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 23:05:08,302 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 23:27:03,970 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-01 23:28:08,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-09-01 23:28:08,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-01 23:28:08,838 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-01 23:28:08,838 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update template OVFs in Data Center Default_foobar >2014-09-01 23:28:08,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-01 23:28:08,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-01 23:28:08,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 00:27:47,726 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 00:28:08,841 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-09-02 00:28:08,842 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 00:28:08,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 00:28:08,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 00:28:08,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 00:28:08,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 00:28:08,845 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 00:44:25,446 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 01:28:08,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-02 01:28:08,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 01:28:08,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 01:28:08,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 01:28:08,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 01:28:08,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 01:28:08,851 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 02:12:22,418 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 02:17:54,992 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 02:28:08,852 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-02 02:28:08,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 02:28:08,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 02:28:08,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 02:28:08,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 02:28:08,856 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 02:28:08,856 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 02:47:08,779 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 03:24:11,326 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 03:28:08,857 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-09-02 03:28:08,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 03:28:08,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 03:28:08,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 03:28:08,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 03:28:08,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 03:28:08,861 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-53) Start deleteAgedOutAuditLogs >2014-09-02 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-53) Finished deleteAgedOutAuditLogs >2014-09-02 03:40:49,133 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 04:18:07,734 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 04:24:34,735 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 04:28:08,862 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-02 04:28:08,863 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 04:28:08,864 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 04:28:08,864 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 04:28:08,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 04:28:08,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 04:28:08,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 05:28:08,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-02 05:28:08,869 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 05:28:08,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 05:28:08,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 05:28:08,871 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 05:28:08,871 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 05:28:08,872 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 06:28:08,873 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-02 06:28:08,874 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 06:28:08,875 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 06:28:08,876 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 06:28:08,877 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 06:28:08,877 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 06:28:08,878 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 06:45:57,567 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 07:03:27,391 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 07:18:35,420 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 07:28:08,878 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-02 07:28:08,880 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 07:28:08,881 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 07:28:08,881 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 07:28:08,882 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 07:28:08,882 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 07:28:08,883 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 08:07:59,290 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 08:28:08,884 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-09-02 08:28:08,885 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 08:28:08,886 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 08:28:08,886 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 08:28:08,887 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 08:28:08,887 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 08:28:08,888 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 08:44:01,426 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 08:58:53,453 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 09:28:08,890 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-02 09:28:08,891 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 09:28:08,892 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 09:28:08,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 09:28:08,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 09:28:08,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 09:28:08,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 09:42:05,203 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 10:24:19,214 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 10:28:08,895 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-02 10:28:08,896 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 10:28:08,898 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 10:28:08,898 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 10:28:08,899 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 10:28:08,899 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 10:28:08,900 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 11:06:54,307 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 11:28:08,901 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-02 11:28:08,902 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 11:28:08,904 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 11:28:08,904 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 11:28:08,905 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 11:28:08,905 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 11:28:08,906 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 11:44:58,563 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Warning, Low disk space.n2_foo_bar domain has 39 GB of free space >2014-09-02 12:28:08,907 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-02 12:28:08,908 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 12:28:08,909 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 12:28:08,910 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 12:28:08,911 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 12:28:08,911 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 12:28:08,911 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 13:07:06,396 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 13:11:08,344 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 13:26:44,802 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2014-09-02 13:26:44,809 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-02 13:26:44,849 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginUserCommand internal: false. >2014-09-02 13:26:44,849 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-11) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-02 13:26:45,075 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-2) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-02 13:28:08,913 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-02 13:28:08,914 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 13:28:08,916 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 13:28:08,916 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 13:28:08,916 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 13:28:08,917 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 13:28:08,917 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 13:57:30,411 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 14:28:08,918 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-02 14:28:08,919 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 14:28:08,920 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 14:28:08,920 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 14:28:08,921 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 14:28:08,921 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 14:28:08,922 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 15:03:01,953 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 15:28:08,923 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-09-02 15:28:08,924 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 15:28:08,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 15:28:08,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 15:28:08,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 15:28:08,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 15:28:08,928 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 15:56:57,492 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 16:22:24,573 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 16:28:08,929 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-02 16:28:08,930 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 16:28:08,931 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 16:28:08,932 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 16:28:08,932 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 16:28:08,932 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 16:28:08,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 16:59:12,100 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 17:00:12,596 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 17:11:33,024 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 17:27:10,421 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 17:28:08,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-02 17:28:08,935 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 17:28:08,936 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 17:28:08,936 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 17:28:08,937 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 17:28:08,937 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 17:28:08,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 18:12:01,604 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 18:28:08,939 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-02 18:28:08,940 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 18:28:08,941 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 18:28:08,941 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 18:28:08,942 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 18:28:08,942 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 18:28:08,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 18:58:38,767 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 19:28:08,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-02 19:28:08,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 19:28:08,947 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 19:28:08,947 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 19:28:08,948 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 19:28:08,948 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 19:28:08,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 20:28:08,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-02 20:28:08,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 20:28:08,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 20:28:08,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 20:28:08,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 20:28:08,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 20:28:08,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 21:14:43,338 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 21:28:08,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-02 21:28:08,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 21:28:08,957 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 21:28:08,957 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 21:28:08,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 21:28:08,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 21:28:08,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 21:39:55,398 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 21:51:01,232 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 21:58:34,777 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 22:28:08,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-02 22:28:08,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 22:28:08,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 22:28:08,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 22:28:08,963 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 22:28:08,963 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 22:28:08,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 22:36:22,871 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 22:56:47,482 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 23:28:08,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-02 23:28:08,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-02 23:28:08,968 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-02 23:28:08,969 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update template OVFs in Data Center Default_foobar >2014-09-02 23:28:08,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-02 23:28:08,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 23:28:08,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-02 23:49:12,367 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 23:50:27,970 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-02 23:58:46,776 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 00:18:56,477 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 00:28:08,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-03 00:28:08,974 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 00:28:08,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 00:28:08,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 00:28:08,976 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 00:28:08,976 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 00:28:08,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 01:28:08,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-03 01:28:08,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 01:28:08,980 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 01:28:08,980 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 01:28:08,981 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 01:28:08,981 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 01:28:08,982 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 01:53:56,579 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 02:27:58,508 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 02:28:08,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-03 02:28:08,985 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 02:28:08,986 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 02:28:08,986 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 02:28:08,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 02:28:08,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 02:28:08,988 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 02:28:13,630 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 02:49:08,519 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 03:07:32,230 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 03:22:25,210 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 03:28:08,988 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-03 03:28:08,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 03:28:08,992 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 03:28:08,992 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 03:28:08,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 03:28:08,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 03:28:08,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Start deleteAgedOutAuditLogs >2014-09-03 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Finished deleteAgedOutAuditLogs >2014-09-03 03:50:23,423 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 03:59:27,823 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 04:14:04,860 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 04:28:08,999 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VMs/Templates Ovf. >2014-09-03 04:28:09,001 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 04:28:09,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 04:28:09,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 04:28:09,003 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 04:28:09,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 04:28:09,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 05:28:09,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-03 05:28:09,006 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 05:28:09,007 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 05:28:09,007 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 05:28:09,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 05:28:09,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 05:28:09,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 06:06:28,755 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 06:16:03,320 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 06:28:09,010 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-03 06:28:09,011 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 06:28:09,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 06:28:09,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 06:28:09,014 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 06:28:09,014 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 06:28:09,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 06:47:03,389 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 07:27:37,617 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 07:28:09,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-03 07:28:09,016 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 07:28:09,018 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 07:28:09,018 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 07:28:09,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 07:28:09,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 07:28:09,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 07:53:35,122 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 08:23:57,283 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-9) [16883152] Running command: LogoutUserCommand internal: false. >2014-09-03 08:23:57,289 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [16883152] Correlation ID: 16883152, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-09-03 08:28:09,021 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-09-03 08:28:09,022 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 08:28:09,023 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 08:28:09,023 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 08:28:09,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 08:28:09,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 08:28:09,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 09:08:26,169 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 09:28:09,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-03 09:28:09,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 09:28:09,027 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 09:28:09,028 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 09:28:09,028 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 09:28:09,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 09:28:09,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 09:36:55,364 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 10:28:09,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-03 10:28:09,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 10:28:09,033 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 10:28:09,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 10:28:09,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 10:28:09,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 10:28:09,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 11:28:09,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-03 11:28:09,037 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 11:28:09,038 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 11:28:09,038 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 11:28:09,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 11:28:09,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 11:28:09,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 12:03:11,559 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 12:13:55,636 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 12:28:09,042 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-03 12:28:09,043 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 12:28:09,044 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 12:28:09,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 12:28:09,046 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 12:28:09,046 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 12:28:09,046 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 13:07:06,221 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 13:28:09,047 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-03 13:28:09,048 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 13:28:09,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 13:28:09,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 13:28:09,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 13:28:09,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 13:28:09,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 14:28:09,052 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-03 14:28:09,053 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 14:28:09,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 14:28:09,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 14:28:09,055 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 14:28:09,055 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 14:28:09,056 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 14:57:14,870 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 15:28:09,057 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-03 15:28:09,058 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 15:28:09,059 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 15:28:09,059 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 15:28:09,060 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 15:28:09,060 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 15:28:09,061 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 16:28:09,062 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-03 16:28:09,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-03 16:28:09,064 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-03 16:28:09,064 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-09-03 16:28:09,065 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-03 16:28:09,065 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 16:28:09,066 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-03 16:31:15,272 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-03 16:39:44,257 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2014-09-03 16:39:44,263 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-03 16:39:44,341 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginUserCommand internal: false. >2014-09-03 16:39:44,343 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-9) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-03 16:39:44,674 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-4) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-03 16:41:08,904 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-21) [3604f46d] Running command: StopVmCommand internal: false. Entities affected : ID: 4f0be376-e2f2-4c86-a07d-49663a164626 Type: VM >2014-09-03 16:41:08,909 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3604f46d] START, DestroyVmVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, force=false, secondsToWait=0, gracefully=false), log id: 250ab4fe >2014-09-03 16:41:08,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3604f46d] START, DestroyVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, vmId=4f0be376-e2f2-4c86-a07d-49663a164626, force=false, secondsToWait=0, gracefully=false), log id: 7663d3a0 >2014-09-03 16:41:10,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3604f46d] FINISH, DestroyVDSCommand, log id: 7663d3a0 >2014-09-03 16:41:10,301 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [3604f46d] FINISH, DestroyVmVDSCommand, return: Down, log id: 250ab4fe >2014-09-03 16:41:10,302 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-23) [df2d14c] Running command: ProcessDownVmCommand internal: true. >2014-09-03 16:41:10,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [3604f46d] Correlation ID: 3604f46d, Job ID: 67dc110d-fcd7-4cf8-a399-227a5e103fbc, Call Stack: null, Custom Event ID: -1, Message: VM av11.1 powered off by admin (Host: slot-7.rhev.lab.eng.brq.redhat.com). >2014-09-03 16:42:35,018 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-8) [31163eab] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-09-03 16:42:35,056 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-09-03 16:42:35,060 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] START, SetVdsStatusVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 39e88501 >2014-09-03 16:42:35,061 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] VDS slot-7.rhev.lab.eng.brq.redhat.com is spm and moved from up calling resetIrs. >2014-09-03 16:42:35,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, ignoreStopFailed = false), log id: 2b79c9b4 >2014-09-03 16:42:35,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] START, SpmStopVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 37393c17 >2014-09-03 16:42:35,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] SpmStopVDSCommand::Stopping SPM on vds slot-7.rhev.lab.eng.brq.redhat.com, pool id 00000002-0002-0002-0002-000000000135 >2014-09-03 16:42:35,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] FINISH, SpmStopVDSCommand, log id: 37393c17 >2014-09-03 16:42:35,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] FINISH, ResetIrsVDSCommand, log id: 2b79c9b4 >2014-09-03 16:42:35,256 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] FINISH, SetVdsStatusVDSCommand, log id: 39e88501 >2014-09-03 16:42:35,315 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-09-03 16:42:35,341 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-7) [31163eab] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-09-03 16:42:35,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [31163eab] Correlation ID: 31163eab, Job ID: 86cbdb5a-ca0f-4846-af68-688f018641e4, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was switched to Maintenance mode by admin. >2014-09-03 16:42:35,872 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f : slot-7.rhev.lab.eng.brq.redhat.com >2014-09-03 16:42:35,906 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-15) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: slot-7.rhev.lab.eng.brq.redhat.com. >2014-09-03 16:42:35,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-69) START, DisconnectStoragePoolVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 1b39c93f >2014-09-03 16:42:40,456 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-99) Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-09-03 16:42:40,461 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-03 16:42:40,467 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Correlation ID: 1602b4dd, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default_foobar. Setting status to Non Responsive. >2014-09-03 16:42:40,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, DisconnectStoragePoolVDSCommand, log id: 1b39c93f >2014-09-03 16:42:40,874 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-69) [6aeb192] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-03 16:42:40,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-69) [6aeb192] START, DisconnectStorageServerVDSCommand(HostName = slot-7.rhev.lab.eng.brq.redhat.com, HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19e53607 >2014-09-03 16:42:41,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-69) [6aeb192] FINISH, DisconnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 19e53607 >2014-09-03 16:42:47,735 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-2) [60445a05] Lock Acquired to object EngineLock [exclusiveLocks= key: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f value: VDS >, sharedLocks= ] >2014-09-03 16:42:47,750 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-38) [60445a05] Running command: RemoveVdsCommand internal: false. Entities affected : ID: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f Type: VDS >2014-09-03 16:42:47,791 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-38) [60445a05] START, RemoveVdsVDSCommand( HostId = db0a9d36-feed-4855-9ea1-cfa0ccc52b0f), log id: 2bb43120 >2014-09-03 16:42:47,791 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-38) [60445a05] vdsManager::disposing >2014-09-03 16:42:47,792 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-38) [60445a05] FINISH, RemoveVdsVDSCommand, log id: 2bb43120 >2014-09-03 16:42:47,797 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-38) [60445a05] Correlation ID: 60445a05, Call Stack: null, Custom Event ID: -1, Message: Host slot-7.rhev.lab.eng.brq.redhat.com was removed by admin. >2014-09-03 16:42:47,797 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-38) [60445a05] Lock freed to object EngineLock [exclusiveLocks= key: db0a9d36-feed-4855-9ea1-cfa0ccc52b0f value: VDS >, sharedLocks= ] >2014-09-03 17:28:09,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-03 18:28:09,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-03 19:28:09,070 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-03 20:28:09,072 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-03 21:28:09,074 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-03 22:28:09,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-03 23:28:09,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) Attempting to update VMs/Templates Ovf. >2014-09-04 00:28:09,080 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-04 01:28:09,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-04 02:28:09,085 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-04 03:28:09,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-04 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-51) Start deleteAgedOutAuditLogs >2014-09-04 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-51) Finished deleteAgedOutAuditLogs >2014-09-04 04:28:09,089 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-04 05:28:09,090 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-09-04 06:28:09,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-04 07:28:09,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-09-04 08:28:09,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-04 09:28:09,099 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-04 10:28:09,100 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-04 11:28:09,102 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-04 12:28:09,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-04 13:28:09,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-04 14:28:09,109 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-04 15:28:09,111 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-04 15:49:09,566 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginUserCommand internal: false. >2014-09-04 15:49:09,573 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-04 15:49:09,614 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-4) [54eb7936] Running command: LogoutUserCommand internal: false. >2014-09-04 15:49:09,619 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [54eb7936] Correlation ID: 54eb7936, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-09-04 16:28:09,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-04 17:28:09,116 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-04 18:28:09,118 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-04 19:28:09,120 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-04 20:28:09,123 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-04 21:28:09,125 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-04 22:28:09,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-04 23:28:09,130 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-05 00:28:09,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-05 01:28:09,134 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-05 02:28:09,136 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-05 03:28:09,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-05 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-82) Start deleteAgedOutAuditLogs >2014-09-05 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-82) Finished deleteAgedOutAuditLogs >2014-09-05 04:28:09,141 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-05 05:28:09,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-05 06:28:09,145 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-09-05 07:28:09,147 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-05 08:28:09,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-05 09:28:09,152 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-05 10:28:09,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-05 11:28:09,156 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-05 12:28:09,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-05 13:28:09,160 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-05 14:28:09,162 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-05 15:28:09,164 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-05 15:56:29,688 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-09-05 15:56:29,694 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-05 15:57:22,800 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2014-09-05 15:57:22,803 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-05 15:57:22,839 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginUserCommand internal: false. >2014-09-05 15:57:22,840 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-8) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-05 15:57:23,162 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-6) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-05 15:59:02,940 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-9) [1379ca15] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-09-05 15:59:02,970 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-05 15:59:02,985 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-09-05 15:59:02,988 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] START, RemoveVdsVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f), log id: 46a8cd76 >2014-09-05 15:59:02,988 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] FINISH, RemoveVdsVDSCommand, log id: 46a8cd76 >2014-09-05 15:59:02,990 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] START, AddVdsVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f), log id: 6be0fa22 >2014-09-05 15:59:02,991 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] AddVds - entered , starting logic to add VDS 51e27211-184e-4403-8de1-c23d0ebbd94f >2014-09-05 15:59:02,992 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] AddVds - VDS 51e27211-184e-4403-8de1-c23d0ebbd94f was added, will try to add it to the resource manager >2014-09-05 15:59:02,992 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [1a2b011d] Entered VdsManager constructor >2014-09-05 15:59:03,016 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [1a2b011d] Initialize vdsBroker (slot-7.rhev.lab.eng.brq.redhat.com,54,321) >2014-09-05 15:59:03,017 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [1a2b011d] VDS 51e27211-184e-4403-8de1-c23d0ebbd94f was added to the Resource Manager >2014-09-05 15:59:03,017 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [1a2b011d] FINISH, AddVdsVDSCommand, log id: 6be0fa22 >2014-09-05 15:59:03,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [1a2b011d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade-rhevh. >2014-09-05 15:59:03,049 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [1a2b011d] Correlation ID: 1379ca15, Job ID: 49808784-5a0e-49a8-a5da-3cfba4f37f13, Call Stack: null, Custom Event ID: -1, Message: Host blade-rhevh was added by admin. >2014-09-05 15:59:03,068 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Lock Acquired to object EngineLock [exclusiveLocks= key: 51e27211-184e-4403-8de1-c23d0ebbd94f value: VDS >, sharedLocks= ] >2014-09-05 15:59:03,076 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Running command: InstallVdsCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-05 15:59:03,109 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Before Installation host 51e27211-184e-4403-8de1-c23d0ebbd94f, blade-rhevh >2014-09-05 15:59:03,114 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] START, SetVdsStatusVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 14bdc39c >2014-09-05 15:59:03,122 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] FINISH, SetVdsStatusVDSCommand, log id: 14bdc39c >2014-09-05 15:59:03,337 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Installation slot-7.rhev.lab.eng.brq.redhat.com: Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-09-05 15:59:03,344 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-09-05 15:59:03,390 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Installation of slot-7.rhev.lab.eng.brq.redhat.com. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-09-05 15:59:03,471 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-45) SSH execute root@slot-7.rhev.lab.eng.brq.redhat.com 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-09-05 15:59:04,528 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Initializing >2014-09-05 15:59:04,535 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Initializing. >2014-09-05 15:59:04,560 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment setup >2014-09-05 15:59:04,566 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Environment setup. >2014-09-05 15:59:04,576 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment packages setup >2014-09-05 15:59:04,582 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Environment packages setup. >2014-09-05 15:59:04,582 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Programs detection >2014-09-05 15:59:04,587 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Programs detection. >2014-09-05 15:59:04,588 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment customization >2014-09-05 15:59:04,593 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Environment customization. >2014-09-05 15:59:04,640 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Host is hypervisor >2014-09-05 15:59:04,647 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Host is hypervisor. >2014-09-05 15:59:04,660 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20140905135903-0k8d0n.log' >2014-09-05 15:59:04,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Logs at host located at: '/tmp/ovirt-host-deploy-20140905135903-0k8d0n.log'. >2014-09-05 15:59:04,785 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host slot-7.rhev.lab.eng.brq.redhat.com reports unique id 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-09-05 15:59:04,809 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B5C04F43354A to Host slot-7.rhev.lab.eng.brq.redhat.com >2014-09-05 15:59:04,934 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Setup validation >2014-09-05 15:59:04,939 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Setup validation. >2014-09-05 15:59:05,077 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Hardware supports virtualization >2014-09-05 15:59:05,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Hardware supports virtualization. >2014-09-05 15:59:05,084 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction setup >2014-09-05 15:59:05,089 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Transaction setup. >2014-09-05 15:59:05,090 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-05 15:59:05,095 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Misc configuration. >2014-09-05 15:59:05,095 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Package installation >2014-09-05 15:59:05,102 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Package installation. >2014-09-05 15:59:06,019 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Initializing Host: blade-rhevh >2014-09-05 15:59:10,810 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-05 15:59:10,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Misc configuration. >2014-09-05 15:59:10,869 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Setting time >2014-09-05 15:59:10,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Setting time. >2014-09-05 15:59:11,497 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Enrolling certificate >2014-09-05 15:59:11,509 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Enrolling certificate. >2014-09-05 15:59:16,798 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction commit >2014-09-05 15:59:16,805 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Transaction commit. >2014-09-05 15:59:16,805 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Closing up >2014-09-05 15:59:16,811 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stage: Closing up. >2014-09-05 15:59:22,482 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stopping libvirtd >2014-09-05 15:59:22,492 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Stopping libvirtd. >2014-09-05 15:59:23,562 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Starting vdsm >2014-09-05 15:59:23,568 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Starting vdsm. >2014-09-05 15:59:40,691 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140905155940-slot-7.rhev.lab.eng.brq.redhat.com-7e842a77.log' >2014-09-05 15:59:40,699 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7e842a77, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade-rhevh. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140905155940-slot-7.rhev.lab.eng.brq.redhat.com-7e842a77.log'. >2014-09-05 15:59:41,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-09-05 15:59:41,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Command PollVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-09-05 15:59:41,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-09-05 15:59:41,563 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Command PollVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-09-05 15:59:42,070 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Engine managed to communicate with VDSM agent on host blade-rhevh >2014-09-05 15:59:42,291 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] START, SetVdsStatusVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 703647e7 >2014-09-05 15:59:42,295 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] FINISH, SetVdsStatusVDSCommand, log id: 703647e7 >2014-09-05 15:59:42,295 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] After Installation host blade-rhevh, oVirtNode >2014-09-05 15:59:42,301 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Correlation ID: 7e842a77, Job ID: 49808784-5a0e-49a8-a5da-3cfba4f37f13, Call Stack: null, Custom Event ID: -1, Message: Host blade-rhevh installed >2014-09-05 15:59:42,312 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-45) [7e842a77] Lock freed to object EngineLock [exclusiveLocks= key: 51e27211-184e-4403-8de1-c23d0ebbd94f value: VDS >, sharedLocks= ] >2014-09-05 15:59:45,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) START, GetHardwareInfoVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f, vds=Host[blade-rhevh,51e27211-184e-4403-8de1-c23d0ebbd94f]), log id: 24773b4a >2014-09-05 15:59:45,238 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) FINISH, GetHardwareInfoVDSCommand, log id: 24773b4a >2014-09-05 15:59:45,266 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-3) [2aed7e71] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-05 15:59:45,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) [2aed7e71] START, GetHardwareInfoVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f, vds=Host[blade-rhevh,51e27211-184e-4403-8de1-c23d0ebbd94f]), log id: 6a8ec82d >2014-09-05 15:59:45,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-3) [2aed7e71] FINISH, GetHardwareInfoVDSCommand, log id: 6a8ec82d >2014-09-05 15:59:45,400 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) [2aed7e71] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host blade-rhevh. >2014-09-05 15:59:45,454 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-3) [65f6235e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-09-05 15:59:45,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-3) [65f6235e] START, SetMOMPolicyParametersVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f), log id: 36bc16b4 >2014-09-05 15:59:45,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-3) [65f6235e] FINISH, SetMOMPolicyParametersVDSCommand, log id: 36bc16b4 >2014-09-05 15:59:45,635 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-3) [65f6235e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade-rhevh. >2014-09-05 15:59:45,643 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-3) [72121455] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-05 15:59:45,648 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-05 16:28:09,167 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-05 17:28:09,170 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-09-05 18:28:09,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-05 19:28:09,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-05 20:28:09,178 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-09-05 21:28:09,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-09-05 22:28:09,181 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-05 23:28:09,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-06 00:28:09,186 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-06 01:28:09,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-06 02:28:09,190 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-06 03:28:09,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-06 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-48) Start deleteAgedOutAuditLogs >2014-09-06 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-48) Finished deleteAgedOutAuditLogs >2014-09-06 04:28:09,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-06 05:28:09,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-06 06:28:09,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-06 07:28:09,202 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-09-06 08:28:09,203 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-06 09:28:09,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-06 10:28:09,209 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-06 11:28:09,211 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-06 12:28:09,213 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-06 13:28:09,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-06 14:28:09,215 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-06 15:28:09,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-06 16:28:09,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-06 17:28:09,219 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-06 18:28:09,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-06 19:28:09,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-06 20:28:09,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-06 21:28:09,223 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-09-06 22:28:09,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-06 23:28:09,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-09-07 00:28:09,229 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-07 01:28:09,230 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-07 02:28:09,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-07 03:28:09,234 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-07 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-80) Start deleteAgedOutAuditLogs >2014-09-07 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-80) Finished deleteAgedOutAuditLogs >2014-09-07 04:28:09,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-07 05:28:09,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-07 06:28:09,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-07 07:28:09,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-07 08:28:09,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-09-07 09:28:09,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-09-07 10:28:09,245 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-07 11:28:09,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-09-07 12:28:09,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-07 13:28:09,251 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-07 14:28:09,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-09-07 15:28:09,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-07 16:28:09,256 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-07 17:28:09,257 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-07 18:28:09,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-09-07 19:28:09,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-07 20:28:09,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-07 21:28:09,264 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) Attempting to update VMs/Templates Ovf. >2014-09-07 22:28:09,266 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-07 23:28:09,268 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-08 00:28:09,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-08 01:28:09,272 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-08 02:28:09,273 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-08 03:28:09,275 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-09-08 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-7) Start deleteAgedOutAuditLogs >2014-09-08 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-7) Finished deleteAgedOutAuditLogs >2014-09-08 04:28:09,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-08 05:28:09,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-08 06:28:09,281 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-08 07:28:09,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-08 08:28:09,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) Attempting to update VMs/Templates Ovf. >2014-09-08 09:28:09,288 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-08 10:28:09,290 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-08 11:28:09,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-08 12:28:09,293 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-08 13:28:09,295 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-09-08 14:28:09,297 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-08 15:28:09,298 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-08 16:28:09,300 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-08 17:07:34,671 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginAdminUserCommand internal: false. >2014-09-08 17:07:34,677 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-08 17:07:34,726 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginUserCommand internal: false. >2014-09-08 17:07:34,727 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-3) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-08 17:07:35,052 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-11) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-08 17:14:18,472 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-32) [672f8cd6] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-08 17:14:18,475 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [672f8cd6] START, SetVdsStatusVDSCommand(HostName = blade-rhevh, HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 14def72d >2014-09-08 17:14:18,479 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-32) [672f8cd6] FINISH, SetVdsStatusVDSCommand, log id: 14def72d >2014-09-08 17:14:18,503 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-32) [672f8cd6] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-08 17:14:18,510 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-32) [672f8cd6] Correlation ID: 672f8cd6, Job ID: 491c9696-e5a1-471a-883b-635534666502, Call Stack: null, Custom Event ID: -1, Message: Host blade-rhevh was switched to Maintenance mode by admin. >2014-09-08 17:14:20,735 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 51e27211-184e-4403-8de1-c23d0ebbd94f : blade-rhevh >2014-09-08 17:14:20,748 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-48) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: blade-rhevh. >2014-09-08 17:16:17,962 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-9) [5d0d07af] Lock Acquired to object EngineLock [exclusiveLocks= key: 51e27211-184e-4403-8de1-c23d0ebbd94f value: VDS >, sharedLocks= ] >2014-09-08 17:16:17,970 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 51e27211-184e-4403-8de1-c23d0ebbd94f Type: VDS >2014-09-08 17:16:17,989 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] START, RemoveVdsVDSCommand( HostId = 51e27211-184e-4403-8de1-c23d0ebbd94f), log id: 708299cd >2014-09-08 17:16:17,989 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] vdsManager::disposing >2014-09-08 17:16:17,989 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] FINISH, RemoveVdsVDSCommand, log id: 708299cd >2014-09-08 17:16:17,993 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] Correlation ID: 5d0d07af, Call Stack: null, Custom Event ID: -1, Message: Host blade-rhevh was removed by admin. >2014-09-08 17:16:17,993 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-18) [5d0d07af] Lock freed to object EngineLock [exclusiveLocks= key: 51e27211-184e-4403-8de1-c23d0ebbd94f value: VDS >, sharedLocks= ] >2014-09-08 17:28:09,303 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-08 17:54:18,588 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-11) [4de57bd8] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-09-08 17:54:18,605 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-11) [51385c7] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-08 17:54:18,610 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-11) [51385c7] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-09-08 17:54:18,612 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] START, RemoveVdsVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 523336ac >2014-09-08 17:54:18,612 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] FINISH, RemoveVdsVDSCommand, log id: 523336ac >2014-09-08 17:54:18,613 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] START, AddVdsVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 28468139 >2014-09-08 17:54:18,613 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] AddVds - entered , starting logic to add VDS 463258f4-94f9-4612-bfc8-139074be69a9 >2014-09-08 17:54:18,615 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] AddVds - VDS 463258f4-94f9-4612-bfc8-139074be69a9 was added, will try to add it to the resource manager >2014-09-08 17:54:18,615 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-11) [51385c7] Entered VdsManager constructor >2014-09-08 17:54:18,652 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-11) [51385c7] Initialize vdsBroker (slot-7.rhev.lab.eng.brq.redhat.com,54,321) >2014-09-08 17:54:18,663 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-11) [51385c7] VDS 463258f4-94f9-4612-bfc8-139074be69a9 was added to the Resource Manager >2014-09-08 17:54:18,663 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-11) [51385c7] FINISH, AddVdsVDSCommand, log id: 28468139 >2014-09-08 17:54:18,668 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [51385c7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade. >2014-09-08 17:54:18,682 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [51385c7] Correlation ID: 4de57bd8, Job ID: 932abc25-a1b6-4664-b17f-ed5dab17f237, Call Stack: null, Custom Event ID: -1, Message: Host blade was added by admin. >2014-09-08 17:54:18,685 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Lock Acquired to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-08 17:54:18,691 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Running command: InstallVdsCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-08 17:54:18,691 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Before Installation host 463258f4-94f9-4612-bfc8-139074be69a9, blade >2014-09-08 17:54:18,694 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] START, SetVdsStatusVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 3d23275c >2014-09-08 17:54:18,697 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] FINISH, SetVdsStatusVDSCommand, log id: 3d23275c >2014-09-08 17:54:18,843 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Installation slot-7.rhev.lab.eng.brq.redhat.com: Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb >2014-09-08 17:54:18,849 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Connected to host slot-7.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 1d:86:a4:c1:89:c5:ce:45:7a:21:58:1e:24:36:d2:eb. >2014-09-08 17:54:18,873 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Installation of slot-7.rhev.lab.eng.brq.redhat.com. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-09-08 17:54:18,897 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-27) SSH execute root@slot-7.rhev.lab.eng.brq.redhat.com 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-09-08 17:54:19,995 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Initializing >2014-09-08 17:54:20,010 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Initializing. >2014-09-08 17:54:20,034 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment setup >2014-09-08 17:54:20,042 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Environment setup. >2014-09-08 17:54:20,050 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment packages setup >2014-09-08 17:54:20,058 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Environment packages setup. >2014-09-08 17:54:20,059 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Programs detection >2014-09-08 17:54:20,065 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Programs detection. >2014-09-08 17:54:20,066 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Environment customization >2014-09-08 17:54:20,072 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Environment customization. >2014-09-08 17:54:20,108 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Host is hypervisor >2014-09-08 17:54:20,115 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Host is hypervisor. >2014-09-08 17:54:20,126 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20140908155419-3dkhmb.log' >2014-09-08 17:54:20,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Logs at host located at: '/tmp/ovirt-host-deploy-20140908155419-3dkhmb.log'. >2014-09-08 17:54:20,193 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host slot-7.rhev.lab.eng.brq.redhat.com reports unique id 4C4C4544-0052-4C10-8058-B5C04F43354A >2014-09-08 17:54:20,218 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B5C04F43354A to Host slot-7.rhev.lab.eng.brq.redhat.com >2014-09-08 17:54:20,314 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Setup validation >2014-09-08 17:54:20,321 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Setup validation. >2014-09-08 17:54:20,459 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Hardware supports virtualization >2014-09-08 17:54:20,465 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Hardware supports virtualization. >2014-09-08 17:54:20,465 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction setup >2014-09-08 17:54:20,470 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Transaction setup. >2014-09-08 17:54:20,471 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-08 17:54:20,476 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Misc configuration. >2014-09-08 17:54:20,476 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Package installation >2014-09-08 17:54:20,481 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Package installation. >2014-09-08 17:54:21,655 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-41) Initializing Host: blade >2014-09-08 17:54:29,182 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-08 17:54:29,189 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Misc configuration. >2014-09-08 17:54:29,255 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Setting time >2014-09-08 17:54:29,261 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Setting time. >2014-09-08 17:54:30,995 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Enrolling certificate >2014-09-08 17:54:31,002 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Enrolling certificate. >2014-09-08 17:54:32,281 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Transaction commit >2014-09-08 17:54:32,288 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Transaction commit. >2014-09-08 17:54:32,289 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stage: Closing up >2014-09-08 17:54:32,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stage: Closing up. >2014-09-08 17:54:40,250 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Stopping libvirtd >2014-09-08 17:54:40,257 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Stopping libvirtd. >2014-09-08 17:54:41,080 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Starting vdsm >2014-09-08 17:54:41,087 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Starting vdsm. >2014-09-08 17:54:59,484 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation slot-7.rhev.lab.eng.brq.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140908175459-slot-7.rhev.lab.eng.brq.redhat.com-2c5fe038.log' >2014-09-08 17:54:59,490 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2c5fe038, Call Stack: null, Custom Event ID: -1, Message: Installing Host blade. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140908175459-slot-7.rhev.lab.eng.brq.redhat.com-2c5fe038.log'. >2014-09-08 17:54:59,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-09-08 17:54:59,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Command PollVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-09-08 17:55:00,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-09-08 17:55:00,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Command PollVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-09-08 17:55:00,854 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Engine managed to communicate with VDSM agent on host blade >2014-09-08 17:55:01,116 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] START, SetVdsStatusVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 2b603f43 >2014-09-08 17:55:01,120 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] FINISH, SetVdsStatusVDSCommand, log id: 2b603f43 >2014-09-08 17:55:01,120 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] After Installation host blade, oVirtNode >2014-09-08 17:55:01,126 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Correlation ID: 2c5fe038, Job ID: 932abc25-a1b6-4664-b17f-ed5dab17f237, Call Stack: null, Custom Event ID: -1, Message: Host blade installed >2014-09-08 17:55:01,131 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-27) [2c5fe038] Lock freed to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-08 17:55:03,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GetHardwareInfoVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, vds=Host[blade,463258f4-94f9-4612-bfc8-139074be69a9]), log id: 4b98e94e >2014-09-08 17:55:03,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GetHardwareInfoVDSCommand, log id: 4b98e94e >2014-09-08 17:55:03,926 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-38) [52bb514a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-08 17:55:03,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-38) [52bb514a] START, GetHardwareInfoVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, vds=Host[blade,463258f4-94f9-4612-bfc8-139074be69a9]), log id: 3113a097 >2014-09-08 17:55:04,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-38) [52bb514a] FINISH, GetHardwareInfoVDSCommand, log id: 3113a097 >2014-09-08 17:55:04,060 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-38) [52bb514a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host blade. >2014-09-08 17:55:04,105 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-38) [67ad08f3] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-09-08 17:55:04,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-38) [67ad08f3] START, SetMOMPolicyParametersVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 686b7afa >2014-09-08 17:55:04,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-38) [67ad08f3] FINISH, SetMOMPolicyParametersVDSCommand, log id: 686b7afa >2014-09-08 17:55:04,272 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-38) [67ad08f3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade. >2014-09-08 17:55:04,278 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-38) [35a57cb] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-08 17:55:04,282 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-08 18:28:09,304 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-08 19:28:09,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-08 20:28:09,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-08 21:28:09,308 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-08 22:28:09,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-08 23:28:09,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-09-09 00:28:09,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-09-09 00:46:09,518 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginAdminUserCommand internal: false. >2014-09-09 00:46:09,523 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-09 00:46:10,239 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginUserCommand internal: false. >2014-09-09 00:46:10,241 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-6) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-09 00:46:10,885 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-1) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-09 00:46:52,359 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-11) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-09 00:48:20,862 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-2) [5aa0c3c2] Running command: LogoutUserCommand internal: false. >2014-09-09 00:48:20,871 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [5aa0c3c2] Correlation ID: 5aa0c3c2, Call Stack: null, Custom Event ID: -1, Message: User admin logged out. >2014-09-09 01:28:09,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-09 02:28:09,318 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-09 03:28:09,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-09 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-24) Start deleteAgedOutAuditLogs >2014-09-09 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-24) Finished deleteAgedOutAuditLogs >2014-09-09 04:28:09,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-09 05:28:09,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-09 06:28:09,326 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-09 07:28:09,328 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-09 08:28:09,330 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-09 09:28:09,331 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-09 10:28:09,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-09 11:28:09,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-09 12:28:09,336 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-09 13:28:09,338 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-09 14:28:09,340 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-09 15:28:09,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-09 15:28:13,741 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-1) Running command: LoginAdminUserCommand internal: false. >2014-09-09 15:28:13,746 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-1) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-09 15:28:14,402 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-09-09 15:28:14,402 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-7) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-09 15:28:15,621 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-8) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-09 15:37:54,989 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-6) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-09 15:38:51,315 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [2009e96e] Lock Acquired to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >, sharedLocks= ] >2014-09-09 15:38:51,321 WARN [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [2009e96e] CanDoAction of action ActivateStorageDomain failed. Reasons:VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ACTIVATE,ACTION_TYPE_FAILED_NO_VDS_IN_POOL >2014-09-09 15:38:51,321 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) [2009e96e] Lock freed to object EngineLock [exclusiveLocks= key: dd3c814d-9d43-46ff-8708-52dc8b452a97 value: STORAGE >, sharedLocks= ] >2014-09-09 15:39:06,966 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-29) [50cd1ded] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:06,968 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [50cd1ded] START, SetVdsStatusVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 67412c1e >2014-09-09 15:39:06,973 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-29) [50cd1ded] FINISH, SetVdsStatusVDSCommand, log id: 67412c1e >2014-09-09 15:39:07,034 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-29) [50cd1ded] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:07,041 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [50cd1ded] Correlation ID: 50cd1ded, Job ID: 87a91ac5-de9f-4be8-a26c-72c9d37fe4c9, Call Stack: null, Custom Event ID: -1, Message: Host blade was switched to Maintenance mode by admin. >2014-09-09 15:39:08,916 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 463258f4-94f9-4612-bfc8-139074be69a9 : blade >2014-09-09 15:39:08,928 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-39) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: blade. >2014-09-09 15:39:20,460 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS, ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-09-09 15:39:20,491 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] START, RemoveVdsVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 53d9ed3f >2014-09-09 15:39:20,491 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [17c7efd8] vdsManager::disposing >2014-09-09 15:39:20,493 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] FINISH, RemoveVdsVDSCommand, log id: 53d9ed3f >2014-09-09 15:39:20,495 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] START, AddVdsVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 22e039f8 >2014-09-09 15:39:20,495 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] AddVds - entered , starting logic to add VDS 463258f4-94f9-4612-bfc8-139074be69a9 >2014-09-09 15:39:20,496 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] AddVds - VDS 463258f4-94f9-4612-bfc8-139074be69a9 was added, will try to add it to the resource manager >2014-09-09 15:39:20,496 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [17c7efd8] Entered VdsManager constructor >2014-09-09 15:39:20,511 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-3) [17c7efd8] Initialize vdsBroker (slot-7.rhev.lab.eng.brq.redhat.com,54,321) >2014-09-09 15:39:20,511 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-3) [17c7efd8] VDS 463258f4-94f9-4612-bfc8-139074be69a9 was added to the Resource Manager >2014-09-09 15:39:20,511 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-3) [17c7efd8] FINISH, AddVdsVDSCommand, log id: 22e039f8 >2014-09-09 15:39:20,516 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [4bff85ba] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:20,529 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-3) [4bff85ba] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-09-09 15:39:20,563 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [4bff85ba] Correlation ID: 17c7efd8, Call Stack: null, Custom Event ID: -1, Message: Host blade configuration was updated by admin. >2014-09-09 15:39:20,586 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-16) [1576d0dd] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:20,614 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-16) [1576d0dd] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:20,614 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-16) [1576d0dd] No changes were detected in setup networks for host blade (ID: 463258f4-94f9-4612-bfc8-139074be69a9) >2014-09-09 15:39:20,945 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-09-09 15:39:20,945 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-09-09 15:39:20,946 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-11) [474f930a] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:20,953 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-09-09 15:39:20,954 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-09-09 15:39:20,959 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [474f930a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade. >2014-09-09 15:39:20,970 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [474f930a] Correlation ID: 474f930a, Call Stack: null, Custom Event ID: -1, Message: Host blade configuration was updated by admin. >2014-09-09 15:39:23,513 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-81) Initializing Host: blade >2014-09-09 15:39:24,824 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-10) [2b6efebc] Lock Acquired to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-09 15:39:24,852 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:24,852 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Before acquiring lock in order to prevent monitoring for host blade from data-center Default_foobar >2014-09-09 15:39:24,852 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Lock acquired, from now a monitoring of host will be skipped for host blade from data-center Default_foobar >2014-09-09 15:39:24,862 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] START, SetVdsStatusVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 79c50493 >2014-09-09 15:39:24,865 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] FINISH, SetVdsStatusVDSCommand, log id: 79c50493 >2014-09-09 15:39:24,873 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Activate finished. Lock released. Monitoring can run now for host blade from data-center Default_foobar >2014-09-09 15:39:24,878 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Correlation ID: 2b6efebc, Job ID: 0012e1db-cab7-46cd-a74f-36081b800876, Call Stack: null, Custom Event ID: -1, Message: Host blade was activated by admin. >2014-09-09 15:39:24,883 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-28) [2b6efebc] Lock freed to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-09 15:39:26,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GetHardwareInfoVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, vds=Host[blade,463258f4-94f9-4612-bfc8-139074be69a9]), log id: 59115a95 >2014-09-09 15:39:26,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GetHardwareInfoVDSCommand, log id: 59115a95 >2014-09-09 15:39:26,751 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-61) [5f12624f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:26,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) [5f12624f] START, GetHardwareInfoVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, vds=Host[blade,463258f4-94f9-4612-bfc8-139074be69a9]), log id: 63631f65 >2014-09-09 15:39:26,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-61) [5f12624f] FINISH, GetHardwareInfoVDSCommand, log id: 63631f65 >2014-09-09 15:39:26,889 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-61) [5f12624f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host blade. >2014-09-09 15:39:26,935 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-61) [4f320c54] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-09 15:39:26,943 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-61) [675d319] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-09 15:39:26,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-61) [675d319] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 44cc8cd >2014-09-09 15:39:27,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-61) [675d319] FINISH, ConnectStorageServerVDSCommand, return: {d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 44cc8cd >2014-09-09 15:39:27,634 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-61) [675d319] Host blade storage connection was succeeded >2014-09-09 15:39:27,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-50) START, ConnectStoragePoolVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: e25ec00 >2014-09-09 15:39:29,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-50) FINISH, ConnectStoragePoolVDSCommand, log id: e25ec00 >2014-09-09 15:39:29,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-61) [675d319] START, SetMOMPolicyParametersVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 6a4150eb >2014-09-09 15:39:30,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-61) [675d319] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6a4150eb >2014-09-09 15:39:30,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-61) [675d319] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host blade. >2014-09-09 15:39:30,116 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-61) [3aafce22] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-09 15:39:33,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) hostFromVds::selectedVds - blade, spmStatus Free, storage pool Default_foobar >2014-09-09 15:39:33,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) starting spm on vds blade, storage pool Default_foobar, prevId -1, LVER 9 >2014-09-09 15:39:33,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) START, SpmStartVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=9, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4a759488 >2014-09-09 15:39:34,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) spmStart polling started: taskId = 169d395b-82c4-40cf-9023-4263594b1d40 >2014-09-09 15:39:52,203 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) spmStart polling ended: taskId = 169d395b-82c4-40cf-9023-4263594b1d40 task status = finished >2014-09-09 15:39:52,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) spmStart polling ended, spm status: SPM >2014-09-09 15:39:52,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) START, HSMClearTaskVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, taskId=169d395b-82c4-40cf-9023-4263594b1d40), log id: 34f2f1d1 >2014-09-09 15:39:52,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, HSMClearTaskVDSCommand, log id: 34f2f1d1 >2014-09-09 15:39:52,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7e3f726e, log id: 4a759488 >2014-09-09 15:39:52,302 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) Initialize Irs proxy from vds: slot-7.rhev.lab.eng.brq.redhat.com >2014-09-09 15:39:52,310 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host blade (Address: slot-7.rhev.lab.eng.brq.redhat.com). >2014-09-09 15:39:52,319 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 698f32e >2014-09-09 15:39:52,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-09-09 15:39:52,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, HSMGetAllTasksInfoVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 1b7ccdc0 >2014-09-09 15:39:52,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 1b7ccdc0 >2014-09-09 15:39:52,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 698f32e >2014-09-09 15:39:52,406 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-44) Discovered no tasks on Storage Pool Default_foobar >2014-09-09 15:40:09,614 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (org.ovirt.thread.pool-4-thread-18) [51b82590] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 99938ede-8d9a-4f22-99f5-c73771944ded Type: Storage >2014-09-09 15:40:09,649 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-25) [2ee465b6] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-09-09 15:40:09,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [2ee465b6] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 25ca2ff0 >2014-09-09 15:40:09,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-25) [2ee465b6] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0}, log id: 25ca2ff0 >2014-09-09 15:40:09,814 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-18) [51b82590] START, AttachStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 99938ede-8d9a-4f22-99f5-c73771944ded), log id: 1bc027bc >2014-09-09 15:40:32,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-18) [51b82590] FINISH, AttachStorageDomainVDSCommand, log id: 1bc027bc >2014-09-09 15:40:32,012 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] Lock Acquired to object EngineLock [exclusiveLocks= key: 99938ede-8d9a-4f22-99f5-c73771944ded value: STORAGE >, sharedLocks= ] >2014-09-09 15:40:32,023 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 99938ede-8d9a-4f22-99f5-c73771944ded Type: Storage >2014-09-09 15:40:32,055 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] Lock freed to object EngineLock [exclusiveLocks= key: 99938ede-8d9a-4f22-99f5-c73771944ded value: STORAGE >, sharedLocks= ] >2014-09-09 15:40:32,061 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] ActivateStorage Domain. Before Connect all hosts to pool. Time:9/9/14 3:40 PM >2014-09-09 15:40:32,064 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-28) [51883d7d] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-09-09 15:40:32,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [51883d7d] START, ConnectStorageServerVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6f80a02f >2014-09-09 15:40:32,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-28) [51883d7d] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0}, log id: 6f80a02f >2014-09-09 15:40:32,117 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] START, ActivateStorageDomainVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, storageDomainId = 99938ede-8d9a-4f22-99f5-c73771944ded), log id: 6b166efb >2014-09-09 15:40:32,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] FINISH, ActivateStorageDomainVDSCommand, log id: 6b166efb >2014-09-09 15:40:32,614 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] ActivateStorage Domain. After Connect all hosts to pool. Time:9/9/14 3:40 PM >2014-09-09 15:40:32,625 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-36) [27502ac2] START, RefreshStoragePoolVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, masterStorageDomainId=dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion=3), log id: 5e9267ff >2014-09-09 15:40:32,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-36) [27502ac2] FINISH, RefreshStoragePoolVDSCommand, log id: 5e9267ff >2014-09-09 15:40:32,733 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-36) [27502ac2] Refreshed vds blade in pool Default_foobar >2014-09-09 15:40:32,738 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-18) [27502ac2] ActivateStorage Domain. After change storage pool status in vds. Time:9/9/14 3:40 PM >2014-09-09 15:40:32,774 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [27502ac2] Correlation ID: 27502ac2, Call Stack: null, Custom Event ID: -1, Message: Storage Domain export_domain (Data Center Default_foobar) was activated by admin >2014-09-09 15:40:32,782 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-18) [27502ac2] Correlation ID: 51b82590, Job ID: 9179a9f2-8a87-4ff8-9554-85b3961d2f66, Call Stack: null, Custom Event ID: -1, Message: Storage Domain export_domain was attached to Data Center Default_foobar by admin >2014-09-09 15:40:58,068 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 15:53:50,932 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 16:28:09,344 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-09 16:28:09,346 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 16:28:09,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 16:28:09,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 16:28:09,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 16:28:09,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 16:28:09,351 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 16:36:15,801 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 17:28:09,352 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-09-09 17:28:09,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 17:28:09,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 17:28:09,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 17:28:09,355 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 17:28:09,355 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 17:28:09,356 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 18:28:09,356 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-09 18:28:09,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 18:28:09,359 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 18:28:09,359 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 18:28:09,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 18:28:09,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 18:28:09,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 18:40:45,519 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 19:28:09,365 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-09 19:28:09,366 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 19:28:09,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 19:28:09,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 19:28:09,368 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 19:28:09,368 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 19:28:09,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 20:28:09,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-09-09 20:28:09,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 20:28:09,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 20:28:09,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 20:28:09,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 20:28:09,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 20:28:09,374 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 21:28:09,375 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-09 21:28:09,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 21:28:09,378 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 21:28:09,378 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 21:28:09,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 21:28:09,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 21:28:09,380 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 22:28:09,381 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Attempting to update VMs/Templates Ovf. >2014-09-09 22:28:09,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 22:28:09,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 22:28:09,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 22:28:09,385 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 22:28:09,385 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 22:28:09,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 22:32:47,329 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 22:56:31,187 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 23:28:09,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-09 23:28:09,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-09 23:28:09,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-09 23:28:09,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update template OVFs in Data Center Default_foobar >2014-09-09 23:28:09,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-09 23:28:09,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 23:28:09,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-09 23:37:55,560 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-09 23:39:26,437 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 00:20:35,648 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 00:28:09,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-10 00:28:09,392 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 00:28:09,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 00:28:09,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 00:28:09,394 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 00:28:09,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 00:28:09,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 00:59:59,015 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 01:23:58,335 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 01:27:00,010 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 01:28:09,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-10 01:28:09,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 01:28:09,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 01:28:09,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 01:28:09,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 01:28:09,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 01:28:09,401 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 01:58:18,201 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 02:28:09,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-10 02:28:09,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 02:28:09,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 02:28:09,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 02:28:09,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 02:28:09,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 02:28:09,407 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 02:41:13,266 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 03:09:59,845 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 03:28:09,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-10 03:28:09,410 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 03:28:09,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 03:28:09,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 03:28:09,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 03:28:09,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 03:28:09,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-50) Start deleteAgedOutAuditLogs >2014-09-10 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-50) Finished deleteAgedOutAuditLogs >2014-09-10 04:28:09,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-10 04:28:09,414 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 04:28:09,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 04:28:09,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 04:28:09,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 04:28:09,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 04:28:09,418 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 05:28:09,418 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-10 05:28:09,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 05:28:09,420 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 05:28:09,420 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 05:28:09,421 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 05:28:09,421 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 05:28:09,422 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 05:59:40,070 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 06:28:09,422 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-10 06:28:09,423 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 06:28:09,425 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 06:28:09,425 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 06:28:09,426 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 06:28:09,426 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 06:28:09,427 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 07:09:06,263 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 07:26:01,046 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 07:28:09,428 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-10 07:28:09,429 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 07:28:09,430 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 07:28:09,430 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 07:28:09,431 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 07:28:09,432 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 07:28:09,433 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 08:11:42,569 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 08:14:59,456 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 08:28:09,433 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-10 08:28:09,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 08:28:09,436 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 08:28:09,436 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 08:28:09,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 08:28:09,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 08:28:09,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 08:28:37,664 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 08:45:02,314 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 09:28:09,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-10 09:28:09,440 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 09:28:09,442 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 09:28:09,442 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 09:28:09,443 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 09:28:09,443 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 09:28:09,444 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 10:28:09,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-10 10:28:09,446 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 10:28:09,447 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 10:28:09,447 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 10:28:09,448 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 10:28:09,448 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 10:28:09,449 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 11:28:09,451 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-10 11:28:09,453 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 11:28:09,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 11:28:09,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 11:28:09,456 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 11:28:09,456 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 11:28:09,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 11:46:48,249 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 12:28:09,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-10 12:28:09,459 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 12:28:09,460 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 12:28:09,460 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 12:28:09,461 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 12:28:09,461 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 12:28:09,462 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 13:00:46,755 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 13:25:31,697 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 13:28:09,463 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-10 13:28:09,464 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 13:28:09,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 13:28:09,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 13:28:09,466 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 13:28:09,466 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 13:28:09,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 13:38:24,377 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 14:28:09,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-10 14:28:09,468 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 14:28:09,469 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 14:28:09,470 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 14:28:09,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 14:28:09,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 14:28:09,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 15:15:05,857 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 15:16:06,443 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 15:28:09,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-10 15:28:09,474 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 15:28:09,476 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 15:28:09,476 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 15:28:09,477 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 15:28:09,477 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 15:28:09,478 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 16:28:09,480 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-10 16:28:09,481 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 16:28:09,482 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 16:28:09,482 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 16:28:09,483 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 16:28:09,483 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 16:28:09,484 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 17:28:09,484 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-10 17:28:09,486 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 17:28:09,487 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 17:28:09,487 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 17:28:09,488 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 17:28:09,488 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 17:28:09,489 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 17:49:20,998 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 18:28:09,491 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-10 18:28:09,494 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 18:28:09,496 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 18:28:09,496 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 18:28:09,496 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 18:28:09,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 18:28:09,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 19:28:09,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-10 19:28:09,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 19:28:09,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 19:28:09,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 19:28:09,500 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 19:28:09,500 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 19:28:09,501 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 20:28:09,502 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-10 20:28:09,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 20:28:09,505 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 20:28:09,505 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 20:28:09,506 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 20:28:09,506 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 20:28:09,507 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 21:05:30,744 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 21:16:06,855 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 21:28:09,507 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-10 21:28:09,509 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 21:28:09,510 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 21:28:09,510 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 21:28:09,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 21:28:09,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 21:28:09,512 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 21:50:56,999 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 22:28:09,512 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-10 22:28:09,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 22:28:09,515 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 22:28:09,515 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 22:28:09,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 22:28:09,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 22:28:09,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 23:10:58,677 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 23:18:33,049 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-10 23:28:09,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-10 23:28:09,519 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-10 23:28:09,520 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-10 23:28:09,520 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-10 23:28:09,521 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-10 23:28:09,521 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-10 23:28:09,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 00:28:09,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-11 00:28:09,523 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 00:28:09,525 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 00:28:09,525 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 00:28:09,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 00:28:09,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 00:28:09,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 00:50:26,685 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 01:20:44,432 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 01:28:09,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-11 01:28:09,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 01:28:09,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 01:28:09,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 01:28:09,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 01:28:09,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 01:28:09,531 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 02:03:54,621 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 02:13:45,248 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 02:17:17,302 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 02:28:09,531 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-11 02:28:09,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 02:28:09,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 02:28:09,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 02:28:09,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 02:28:09,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 02:28:09,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 03:13:49,825 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 03:24:56,218 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 03:28:09,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-11 03:28:09,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 03:28:09,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 03:28:09,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 03:28:09,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 03:28:09,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 03:28:09,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-70) Start deleteAgedOutAuditLogs >2014-09-11 03:35:35,007 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-70) Finished deleteAgedOutAuditLogs >2014-09-11 03:50:41,060 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 04:24:00,453 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 04:28:09,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-11 04:28:09,544 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 04:28:09,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 04:28:09,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 04:28:09,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 04:28:09,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 04:28:09,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 05:28:09,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-11 05:28:09,550 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 05:28:09,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 05:28:09,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 05:28:09,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 05:28:09,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 05:28:09,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 06:28:09,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-11 06:28:09,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 06:28:09,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 06:28:09,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 06:28:09,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 06:28:09,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 06:28:09,560 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 07:18:13,287 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 07:28:09,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-11 07:28:09,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 07:28:09,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 07:28:09,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 07:28:09,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 07:28:09,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 07:28:09,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 07:36:54,433 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 07:40:41,706 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 08:28:09,567 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-11 08:28:09,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 08:28:09,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 08:28:09,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 08:28:09,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 08:28:09,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 08:28:09,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 08:38:36,671 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 09:24:57,849 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 09:28:09,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-11 09:28:09,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 09:28:09,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 09:28:09,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 09:28:09,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 09:28:09,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 09:28:09,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 09:38:20,572 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 10:28:09,578 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-11 10:28:09,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 10:28:09,581 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 10:28:09,581 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 10:28:09,582 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 10:28:09,582 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 10:28:09,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 11:28:09,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-11 11:28:09,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 11:28:09,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 11:28:09,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 11:28:09,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 11:28:09,587 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 11:28:09,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 11:31:57,485 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 12:21:41,429 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 12:28:09,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-11 12:28:09,589 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 12:28:09,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 12:28:09,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 12:28:09,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 12:28:09,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 12:28:09,593 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 13:28:09,594 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-11 13:28:09,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 13:28:09,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 13:28:09,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 13:28:09,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 13:28:09,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 13:28:09,598 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 14:09:15,523 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 14:28:09,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-11 14:28:09,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 14:28:09,601 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 14:28:09,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 14:28:09,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 14:28:09,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 14:28:09,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 15:05:18,625 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 15:28:09,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-11 15:28:09,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 15:28:09,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 15:28:09,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 15:28:09,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 15:28:09,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 15:28:09,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 15:36:37,586 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 15:37:07,880 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 16:28:09,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-11 16:28:09,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 16:28:09,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 16:28:09,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 16:28:09,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 16:28:09,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 16:28:09,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 17:28:09,613 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-11 17:28:09,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 17:28:09,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 17:28:09,616 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 17:28:09,617 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 17:28:09,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 17:28:09,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 18:28:09,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-09-11 18:28:09,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 18:28:09,621 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 18:28:09,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 18:28:09,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 18:28:09,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 18:28:09,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 19:05:24,767 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 19:28:09,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-09-11 19:28:09,626 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 19:28:09,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 19:28:09,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 19:28:09,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 19:28:09,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 19:28:09,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 20:25:42,663 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 20:28:09,630 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-11 20:28:09,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 20:28:09,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 20:28:09,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 20:28:09,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 20:28:09,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 20:28:09,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 21:28:09,637 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-11 21:28:09,638 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 21:28:09,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 21:28:09,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 21:28:09,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 21:28:09,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 21:28:09,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 22:16:02,608 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 22:16:32,902 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 22:28:09,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-11 22:28:09,644 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 22:28:09,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 22:28:09,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 22:28:09,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 22:28:09,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 22:28:09,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 22:39:31,400 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 22:55:41,291 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 23:13:51,914 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-11 23:28:09,648 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-11 23:28:09,649 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-11 23:28:09,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-11 23:28:09,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-11 23:28:09,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-11 23:28:09,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-11 23:28:09,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 00:28:09,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-12 00:28:09,654 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 00:28:09,655 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 00:28:09,656 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 00:28:09,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 00:28:09,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 00:28:09,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 00:28:51,123 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 01:28:09,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-12 01:28:09,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 01:28:09,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 01:28:09,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 01:28:09,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 01:28:09,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 01:28:09,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 02:28:09,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-12 02:28:09,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 02:28:09,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 02:28:09,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 02:28:09,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 02:28:09,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 02:28:09,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 03:28:09,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-12 03:28:09,670 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 03:28:09,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 03:28:09,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 03:28:09,673 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 03:28:09,673 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 03:28:09,674 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-92) Start deleteAgedOutAuditLogs >2014-09-12 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-92) Finished deleteAgedOutAuditLogs >2014-09-12 04:28:09,675 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-12 04:28:09,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 04:28:09,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 04:28:09,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 04:28:09,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 04:28:09,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 04:28:09,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 05:28:09,680 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-12 05:28:09,681 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 05:28:09,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 05:28:09,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 05:28:09,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 05:28:09,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 05:28:09,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 05:41:41,566 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 05:53:33,273 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 06:04:24,594 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 06:06:25,837 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 06:28:09,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-12 06:28:09,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 06:28:09,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 06:28:09,685 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 06:28:09,685 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 06:28:09,685 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 06:28:09,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 07:13:10,664 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 07:28:09,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-12 07:28:09,689 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 07:28:09,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 07:28:09,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 07:28:09,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 07:28:09,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 07:28:09,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 08:28:09,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-12 08:28:09,694 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 08:28:09,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 08:28:09,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 08:28:09,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 08:28:09,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 08:28:09,698 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 08:46:44,978 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 09:28:09,699 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-12 09:28:09,700 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 09:28:09,701 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 09:28:09,701 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 09:28:09,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 09:28:09,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 09:28:09,703 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 09:46:35,169 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 09:54:55,190 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 10:28:09,703 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-12 10:28:09,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 10:28:09,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 10:28:09,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 10:28:09,707 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 10:28:09,707 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 10:28:09,708 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 10:31:01,482 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 10:43:08,613 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 11:00:33,730 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 11:02:34,922 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 11:28:09,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-12 11:28:09,710 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 11:28:09,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 11:28:09,711 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 11:28:09,712 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 11:28:09,712 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 11:28:09,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 12:28:09,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-12 12:28:09,716 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 12:28:09,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 12:28:09,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 12:28:09,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 12:28:09,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 12:28:09,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 13:21:26,190 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 13:28:09,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-12 13:28:09,722 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 13:28:09,723 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 13:28:09,723 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 13:28:09,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 13:28:09,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 13:28:09,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 13:32:02,468 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 14:28:09,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-12 14:28:09,727 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 14:28:09,728 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 14:28:09,728 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 14:28:09,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 14:28:09,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 14:28:09,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 14:56:52,491 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 15:28:09,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-12 15:28:09,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 15:28:09,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 15:28:09,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 15:28:09,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 15:28:09,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 15:28:09,735 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 16:28:09,735 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-12 16:28:09,737 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 16:28:09,738 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 16:28:09,738 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 16:28:09,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 16:28:09,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 16:28:09,740 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 17:28:09,741 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-12 17:28:09,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 17:28:09,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 17:28:09,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 17:28:09,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 17:28:09,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 17:28:09,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 17:29:06,538 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 18:28:09,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-12 18:28:09,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 18:28:09,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 18:28:09,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 18:28:09,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 18:28:09,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 18:28:09,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 18:37:31,949 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 19:28:09,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-12 19:28:09,752 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 19:28:09,753 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 19:28:09,753 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 19:28:09,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 19:28:09,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 19:28:09,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 20:28:09,756 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VMs/Templates Ovf. >2014-09-12 20:28:09,757 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 20:28:09,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 20:28:09,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 20:28:09,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 20:28:09,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 20:28:09,761 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 21:28:09,762 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-12 21:28:09,763 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 21:28:09,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 21:28:09,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 21:28:09,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 21:28:09,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 21:28:09,766 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 21:51:25,766 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 22:19:27,254 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 22:28:09,767 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-12 22:28:09,768 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 22:28:09,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 22:28:09,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 22:28:09,771 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 22:28:09,771 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 22:28:09,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 22:37:53,379 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 23:13:32,456 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-12 23:28:09,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-12 23:28:09,774 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-12 23:28:09,775 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-12 23:28:09,775 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-12 23:28:09,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-12 23:28:09,777 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-12 23:28:09,777 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 00:23:25,323 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 00:28:09,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-13 00:28:09,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 00:28:09,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 00:28:09,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 00:28:09,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 00:28:09,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 00:28:09,783 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 00:51:41,654 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 01:09:37,126 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 01:28:09,783 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-13 01:28:09,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 01:28:09,786 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 01:28:09,786 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 01:28:09,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 01:28:09,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 01:28:09,788 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 02:28:09,789 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-13 02:28:09,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 02:28:09,792 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 02:28:09,792 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 02:28:09,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 02:28:09,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 02:28:09,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 03:28:09,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-13 03:28:09,796 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 03:28:09,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 03:28:09,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 03:28:09,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 03:28:09,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 03:28:09,799 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 03:28:58,876 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 03:30:44,868 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-84) Start deleteAgedOutAuditLogs >2014-09-13 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-84) Finished deleteAgedOutAuditLogs >2014-09-13 04:28:09,800 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-13 04:28:09,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 04:28:09,803 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 04:28:09,803 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 04:28:09,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 04:28:09,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 04:28:09,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 04:56:35,645 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 04:59:52,525 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 05:28:09,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-13 05:28:09,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 05:28:09,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 05:28:09,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 05:28:09,810 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 05:28:09,810 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 05:28:09,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 06:28:09,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-13 06:28:09,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 06:28:09,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 06:28:09,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 06:28:09,815 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 06:28:09,815 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 06:28:09,816 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 06:36:43,601 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 07:28:09,817 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-13 07:28:09,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 07:28:09,820 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 07:28:09,820 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 07:28:09,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 07:28:09,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 07:28:09,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 08:08:58,872 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 08:16:33,218 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 08:23:07,126 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 08:28:09,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-09-13 08:28:09,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 08:28:09,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 08:28:09,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 08:28:09,825 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 08:28:09,825 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 08:28:09,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 08:48:52,163 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 08:58:58,178 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 09:28:09,826 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-13 09:28:09,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 09:28:09,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 09:28:09,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 09:28:09,830 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 09:28:09,830 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 09:28:09,831 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 09:57:32,572 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 10:28:09,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-09-13 10:28:09,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 10:28:09,834 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 10:28:09,834 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 10:28:09,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 10:28:09,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 10:28:09,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 11:02:11,052 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 11:19:51,584 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 11:28:09,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-09-13 11:28:09,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 11:28:09,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 11:28:09,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 11:28:09,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 11:28:09,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 11:28:09,841 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 11:53:11,462 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 12:28:09,841 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-13 12:28:09,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 12:28:09,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 12:28:09,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 12:28:09,845 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 12:28:09,845 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 12:28:09,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 12:39:24,329 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 13:28:09,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-13 13:28:09,847 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 13:28:09,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 13:28:09,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 13:28:09,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 13:28:09,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 13:28:09,851 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 13:42:46,192 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 14:18:52,444 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 14:28:09,852 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VMs/Templates Ovf. >2014-09-13 14:28:09,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 14:28:09,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 14:28:09,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 14:28:09,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 14:28:09,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 14:28:09,856 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 15:18:30,207 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 15:20:01,067 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 15:28:09,857 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-09-13 15:28:09,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 15:28:09,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 15:28:09,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 15:28:09,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 15:28:09,861 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 15:28:09,861 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 15:46:28,632 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 16:09:12,091 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 16:28:09,861 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-09-13 16:28:09,863 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 16:28:09,865 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 16:28:09,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 16:28:09,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 16:28:09,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 16:28:09,868 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 16:55:24,610 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 17:28:09,869 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-13 17:28:09,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 17:28:09,872 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 17:28:09,872 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 17:28:09,873 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 17:28:09,873 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 17:28:09,874 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 18:14:26,194 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 18:28:09,875 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-13 18:28:09,876 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 18:28:09,878 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 18:28:09,878 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 18:28:09,879 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 18:28:09,879 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 18:28:09,880 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 19:28:09,880 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-13 19:28:09,882 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 19:28:09,883 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 19:28:09,883 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 19:28:09,884 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 19:28:09,885 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 19:28:09,885 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 20:28:09,886 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-13 20:28:09,887 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 20:28:09,888 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 20:28:09,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 20:28:09,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 20:28:09,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 20:28:09,890 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 20:54:45,699 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 21:28:09,890 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-13 21:28:09,892 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 21:28:09,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 21:28:09,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 21:28:09,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 21:28:09,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 21:28:09,895 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 22:07:43,037 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 22:24:53,152 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 2 tasks in the queue. >2014-09-13 22:24:53,152 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 22:24:53,152 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 22:28:09,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-13 22:28:09,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 22:28:09,896 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 22:28:09,896 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 22:28:09,897 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 22:28:09,897 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 22:28:09,900 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 23:25:44,285 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-13 23:28:09,900 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-09-13 23:28:09,901 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-13 23:28:09,903 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-13 23:28:09,903 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update template OVFs in Data Center Default_foobar >2014-09-13 23:28:09,904 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-13 23:28:09,904 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-13 23:28:09,905 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 00:07:08,320 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 00:28:09,906 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-14 00:28:09,907 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 00:28:09,909 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 00:28:09,909 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 00:28:09,910 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 00:28:09,910 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 00:28:09,911 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 00:43:14,624 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 01:28:09,911 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-09-14 01:28:09,913 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 01:28:09,914 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 01:28:09,914 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 01:28:09,915 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 01:28:09,915 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 01:28:09,916 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 02:28:09,918 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-14 02:28:09,919 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 02:28:09,921 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 02:28:09,921 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 02:28:09,922 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 02:28:09,922 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 02:28:09,923 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 03:00:04,857 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 03:03:52,177 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 03:19:16,232 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 03:28:09,924 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-14 03:28:09,925 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 03:28:09,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 03:28:09,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 03:28:09,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 03:28:09,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 03:28:09,928 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-51) Start deleteAgedOutAuditLogs >2014-09-14 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-51) Finished deleteAgedOutAuditLogs >2014-09-14 03:43:54,760 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 03:44:46,337 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 04:28:09,930 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-14 04:28:09,931 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 04:28:09,932 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 04:28:09,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 04:28:09,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 04:28:09,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 04:28:09,934 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 05:11:37,362 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 05:28:09,934 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-14 05:28:09,935 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 05:28:09,936 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 05:28:09,937 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 05:28:09,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 05:28:09,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 05:28:09,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 06:28:09,940 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-14 06:28:09,941 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 06:28:09,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 06:28:09,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 06:28:09,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 06:28:09,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 06:28:09,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 07:01:57,793 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 07:28:09,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-14 07:28:09,947 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 07:28:09,948 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 07:28:09,948 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 07:28:09,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 07:28:09,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 07:28:09,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 07:58:45,816 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 08:28:09,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-14 08:28:09,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 08:28:09,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 08:28:09,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 08:28:09,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 08:28:09,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 08:28:09,955 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 08:30:03,980 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 09:28:09,955 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-14 09:28:09,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 09:28:09,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 09:28:09,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 09:28:09,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 09:28:09,959 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 09:28:09,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 09:35:27,681 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 10:28:09,961 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-14 10:28:09,963 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 10:28:09,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 10:28:09,964 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 10:28:09,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 10:28:09,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 10:28:09,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 11:17:14,085 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 11:28:09,968 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-14 11:28:09,969 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 11:28:09,971 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 11:28:09,971 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 11:28:09,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 11:28:09,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 11:28:09,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 11:46:00,973 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 11:54:14,673 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 12:28:09,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-14 12:28:09,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 12:28:09,976 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 12:28:09,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 12:28:09,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 12:28:09,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 12:28:09,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 12:29:26,438 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 13:28:09,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-09-14 13:28:09,981 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 13:28:09,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 13:28:09,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 13:28:09,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 13:28:09,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 13:28:09,985 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 14:07:39,434 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 14:28:09,986 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-14 14:28:09,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 14:28:09,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 14:28:09,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 14:28:09,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 14:28:09,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 14:28:09,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 14:44:43,405 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 15:28:09,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-14 15:28:09,991 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 15:28:09,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 15:28:09,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 15:28:09,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 15:28:09,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 15:28:09,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 15:35:32,008 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 16:28:09,996 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-14 16:28:10,000 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 16:28:10,001 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 16:28:10,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 16:28:10,003 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 16:28:10,003 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 16:28:10,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 16:37:23,369 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 17:28:10,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-14 17:28:10,006 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 17:28:10,007 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 17:28:10,007 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 17:28:10,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 17:28:10,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 17:28:10,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 18:28:10,010 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-09-14 18:28:10,011 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 18:28:10,012 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 18:28:10,012 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 18:28:10,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 18:28:10,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 18:28:10,014 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 19:22:45,539 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 19:28:10,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-14 19:28:10,016 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 19:28:10,018 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 19:28:10,018 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 19:28:10,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 19:28:10,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 19:28:10,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 19:58:21,983 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 20:28:10,021 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-14 20:28:10,022 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 20:28:10,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 20:28:10,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 20:28:10,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 20:28:10,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 20:28:10,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 21:28:10,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-14 21:28:10,028 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 21:28:10,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 21:28:10,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 21:28:10,030 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 21:28:10,030 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 21:28:10,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 21:51:43,778 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 22:19:00,555 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 22:28:10,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-14 22:28:10,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 22:28:10,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 22:28:10,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 22:28:10,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 22:28:10,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 22:28:10,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 22:33:54,442 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 22:58:08,729 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 23:28:10,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-14 23:28:10,037 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-14 23:28:10,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-14 23:28:10,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-09-14 23:28:10,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-14 23:28:10,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 23:28:10,041 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-14 23:34:45,232 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-14 23:55:27,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 00:23:13,604 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 00:28:10,042 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-15 00:28:10,043 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 00:28:10,044 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 00:28:10,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 00:28:10,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 00:28:10,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 00:28:10,046 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 00:30:18,034 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 01:28:10,047 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-15 01:28:10,048 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 01:28:10,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 01:28:10,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 01:28:10,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 01:28:10,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 01:28:10,052 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 02:28:10,053 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-15 02:28:10,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 02:28:10,056 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 02:28:10,056 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 02:28:10,057 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 02:28:10,057 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 02:28:10,058 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 02:42:50,431 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 03:28:10,059 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-15 03:28:10,060 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 03:28:10,062 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 03:28:10,062 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 03:28:10,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 03:28:10,063 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 03:28:10,064 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-60) Start deleteAgedOutAuditLogs >2014-09-15 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-60) Finished deleteAgedOutAuditLogs >2014-09-15 04:07:40,819 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 04:28:10,065 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-09-15 04:28:10,066 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 04:28:10,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 04:28:10,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 04:28:10,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 04:28:10,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 04:28:10,069 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 05:08:46,667 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 05:28:10,069 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-15 05:28:10,071 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 05:28:10,072 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 05:28:10,072 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 05:28:10,073 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 05:28:10,073 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 05:28:10,074 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 05:41:05,401 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 05:54:13,187 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 06:28:10,075 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-15 06:28:10,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 06:28:10,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 06:28:10,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 06:28:10,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 06:28:10,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 06:28:10,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 07:00:36,767 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 07:27:07,797 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 07:28:10,079 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-15 07:28:10,080 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 07:28:10,081 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 07:28:10,081 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 07:28:10,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 07:28:10,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 07:28:10,083 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 08:15:20,873 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 08:25:42,075 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 08:28:10,083 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-15 08:28:10,084 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 08:28:10,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 08:28:10,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 08:28:10,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 08:28:10,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 08:28:10,089 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 08:54:59,601 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 09:25:47,678 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 09:28:10,090 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-15 09:28:10,091 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 09:28:10,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 09:28:10,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 09:28:10,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 09:28:10,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 09:28:10,094 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 09:34:22,705 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 10:03:39,735 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 10:24:24,875 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 10:25:52,697 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 10:28:10,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-15 10:28:10,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 10:28:10,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 10:28:10,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 10:28:10,100 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 10:28:10,100 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 10:28:10,101 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 10:58:02,274 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 11:28:10,101 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-15 11:28:10,103 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 11:28:10,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 11:28:10,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 11:28:10,105 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 11:28:10,105 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 11:28:10,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 11:32:10,249 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 12:01:48,944 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 12:24:17,117 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 12:28:10,107 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-09-15 12:28:10,108 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 12:28:10,110 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 12:28:10,110 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 12:28:10,111 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 12:28:10,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 12:28:10,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 12:42:27,866 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 13:28:10,113 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-15 13:28:10,114 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 13:28:10,115 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 13:28:10,115 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 13:28:10,116 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 13:28:10,116 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 13:28:10,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 14:28:10,118 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-15 14:28:10,119 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 14:28:10,121 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 14:28:10,121 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 14:28:10,122 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 14:28:10,122 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 14:28:10,123 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 14:42:38,787 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 15:28:10,125 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-15 15:28:10,126 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 15:28:10,127 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 15:28:10,127 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 15:28:10,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 15:28:10,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 15:28:10,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 15:58:08,217 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 16:28:10,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-15 16:28:10,131 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 16:28:10,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 16:28:10,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 16:28:10,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 16:28:10,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 16:28:10,134 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 17:28:10,135 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-15 17:28:10,136 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 17:28:10,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 17:28:10,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 17:28:10,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 17:28:10,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 17:28:10,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 17:56:18,505 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 18:10:11,833 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 18:26:42,470 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 18:28:10,140 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-15 18:28:10,141 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 18:28:10,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 18:28:10,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 18:28:10,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 18:28:10,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 18:28:10,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 19:28:10,145 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-15 19:28:10,146 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 19:28:10,147 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 19:28:10,147 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 19:28:10,148 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 19:28:10,148 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 19:28:10,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 20:25:15,634 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 20:28:10,150 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-15 20:28:10,151 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 20:28:10,152 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 20:28:10,152 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 20:28:10,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 20:28:10,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 20:28:10,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 20:52:01,080 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 21:28:10,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-15 21:28:10,156 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 21:28:10,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 21:28:10,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 21:28:10,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 21:28:10,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 21:28:10,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 21:34:10,908 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-15 22:28:10,160 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-15 22:28:10,161 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 22:28:10,162 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 22:28:10,162 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 22:28:10,163 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 22:28:10,163 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 22:28:10,164 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 23:28:10,165 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-15 23:28:10,166 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-15 23:28:10,168 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-15 23:28:10,168 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-15 23:28:10,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-15 23:28:10,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-15 23:28:10,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 00:28:10,171 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-16 00:28:10,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 00:28:10,173 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 00:28:10,173 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 00:28:10,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 00:28:10,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 00:28:10,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 00:36:29,943 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 01:28:10,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-16 01:28:10,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 01:28:10,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 01:28:10,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 01:28:10,178 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 01:28:10,178 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 01:28:10,179 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 02:28:10,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VMs/Templates Ovf. >2014-09-16 02:28:10,181 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 02:28:10,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 02:28:10,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 02:28:10,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 02:28:10,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 02:28:10,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-96) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 02:36:10,449 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 03:28:10,185 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-16 03:28:10,186 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 03:28:10,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 03:28:10,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 03:28:10,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 03:28:10,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 03:28:10,190 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-58) Start deleteAgedOutAuditLogs >2014-09-16 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-58) Finished deleteAgedOutAuditLogs >2014-09-16 04:28:10,191 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VMs/Templates Ovf. >2014-09-16 04:28:10,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 04:28:10,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 04:28:10,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 04:28:10,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 04:28:10,195 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 04:28:10,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-62) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 05:27:36,151 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 05:28:10,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-16 05:28:10,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 05:28:10,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 05:28:10,200 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 05:28:10,201 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 05:28:10,202 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 05:28:10,203 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 06:28:10,204 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-09-16 06:28:10,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 06:28:10,206 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 06:28:10,206 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 06:28:10,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 06:28:10,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 06:28:10,208 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 06:48:08,405 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 07:18:11,348 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 07:22:22,798 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 07:22:22,812 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 07:28:10,209 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-16 07:28:10,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 07:28:10,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 07:28:10,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 07:28:10,213 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 07:28:10,213 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 07:28:10,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 08:28:10,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-16 08:28:10,215 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 08:28:10,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 08:28:10,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 08:28:10,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 08:28:10,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 08:28:10,219 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 09:28:10,221 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-16 09:28:10,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 09:28:10,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 09:28:10,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 09:28:10,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 09:28:10,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 09:28:10,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 10:18:13,161 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 10:18:43,438 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 10:28:10,229 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-16 10:28:10,231 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 10:28:10,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 10:28:10,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 10:28:10,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 10:28:10,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 10:28:10,234 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 10:54:04,277 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 11:28:10,235 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-16 11:28:10,237 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 11:28:10,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 11:28:10,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 11:28:10,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 11:28:10,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 11:28:10,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 12:28:10,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-16 12:28:10,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 12:28:10,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 12:28:10,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 12:28:10,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 12:28:10,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 12:28:10,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 13:28:10,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-16 13:28:10,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 13:28:10,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 13:28:10,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 13:28:10,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 13:28:10,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 13:28:10,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 13:35:55,429 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 14:28:10,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-16 14:28:10,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 14:28:10,252 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 14:28:10,252 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 14:28:10,252 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 14:28:10,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 14:28:10,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 15:28:10,254 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-16 15:28:10,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 15:28:10,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 15:28:10,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 15:28:10,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 15:28:10,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 15:28:10,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 16:28:10,262 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-09-16 16:28:10,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 16:28:10,267 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 16:28:10,267 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 16:28:10,268 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 16:28:10,268 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 16:28:10,269 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 17:24:46,446 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 17:28:10,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-16 17:28:10,271 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 17:28:10,272 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 17:28:10,273 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 17:28:10,273 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 17:28:10,274 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 17:28:10,275 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 18:26:32,317 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 18:28:10,275 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-09-16 18:28:10,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 18:28:10,278 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 18:28:10,278 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 18:28:10,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 18:28:10,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 18:28:10,281 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 19:28:10,282 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-09-16 19:28:10,283 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 19:28:10,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 19:28:10,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 19:28:10,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 19:28:10,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 19:28:10,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 20:28:10,287 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-16 20:28:10,289 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 20:28:10,290 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 20:28:10,290 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 20:28:10,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 20:28:10,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 20:28:10,292 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 21:28:10,293 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-16 21:28:10,294 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 21:28:10,295 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 21:28:10,295 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 21:28:10,296 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 21:28:10,296 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 21:28:10,297 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 21:47:30,680 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 22:28:10,298 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-16 22:28:10,299 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 22:28:10,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 22:28:10,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 22:28:10,302 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 22:28:10,302 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 22:28:10,302 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 22:30:26,206 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 23:28:10,304 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-09-16 23:28:10,305 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-16 23:28:10,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-16 23:28:10,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update template OVFs in Data Center Default_foobar >2014-09-16 23:28:10,307 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-16 23:28:10,308 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 23:28:10,308 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-16 23:28:15,082 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-16 23:51:13,690 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 00:28:10,309 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-09-17 00:28:10,311 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 00:28:10,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 00:28:10,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 00:28:10,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 00:28:10,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 00:28:10,315 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 00:46:46,506 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 01:28:10,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-17 01:28:10,317 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 01:28:10,319 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 01:28:10,319 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 01:28:10,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 01:28:10,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 01:28:10,321 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 02:00:14,661 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 02:28:10,321 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-17 02:28:10,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 02:28:10,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 02:28:10,324 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 02:28:10,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 02:28:10,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 02:28:10,326 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 03:28:10,327 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-17 03:28:10,329 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 03:28:10,330 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 03:28:10,330 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 03:28:10,331 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 03:28:10,331 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 03:28:10,332 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 03:35:35,000 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-7) Start deleteAgedOutAuditLogs >2014-09-17 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-7) Finished deleteAgedOutAuditLogs >2014-09-17 04:28:10,332 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-17 04:28:10,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 04:28:10,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 04:28:10,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 04:28:10,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 04:28:10,335 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 04:28:10,336 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 05:27:00,470 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 05:28:10,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-17 05:28:10,338 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 05:28:10,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 05:28:10,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 05:28:10,342 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 05:28:10,342 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 05:28:10,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 05:56:32,960 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 06:21:48,056 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 06:28:10,344 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-17 06:28:10,345 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 06:28:10,347 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 06:28:10,347 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 06:28:10,347 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 06:28:10,348 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 06:28:10,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 07:28:10,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-17 07:28:10,350 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 07:28:10,352 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 07:28:10,352 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 07:28:10,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 07:28:10,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 07:28:10,353 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 07:41:19,885 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 08:07:05,084 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 08:28:10,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-17 08:28:10,355 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 08:28:10,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 08:28:10,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 08:28:10,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 08:28:10,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 08:28:10,359 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 09:11:58,434 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 09:12:28,709 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 09:28:10,360 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-17 09:28:10,361 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 09:28:10,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 09:28:10,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 09:28:10,363 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 09:28:10,363 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 09:28:10,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 09:48:34,793 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 10:26:57,141 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 10:28:10,364 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-17 10:28:10,365 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 10:28:10,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 10:28:10,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 10:28:10,368 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 10:28:10,368 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 10:28:10,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 10:46:38,930 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 11:28:10,370 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-17 11:28:10,372 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 11:28:10,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 11:28:10,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 11:28:10,375 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 11:28:10,375 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 11:28:10,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 11:46:28,901 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-19) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 12:28:10,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-17 12:28:10,377 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 12:28:10,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 12:28:10,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 12:28:10,380 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 12:28:10,380 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 12:28:10,380 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 12:29:10,666 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 13:28:10,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-17 13:28:10,383 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 13:28:10,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 13:28:10,385 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 13:28:10,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 13:28:10,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 13:28:10,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 13:53:00,292 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 13:56:05,108 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 14:28:10,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-17 14:28:10,389 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 14:28:10,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 14:28:10,391 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 14:28:10,392 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 14:28:10,392 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 14:28:10,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 14:56:22,595 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 15:28:10,394 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-17 15:28:10,395 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 15:28:10,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 15:28:10,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 15:28:10,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 15:28:10,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 15:28:10,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 16:27:46,986 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 16:28:10,399 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-17 16:28:10,400 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 16:28:10,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 16:28:10,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 16:28:10,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 16:28:10,403 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 16:28:10,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 16:59:35,501 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 17:28:10,405 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-17 17:28:10,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 17:28:10,407 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 17:28:10,407 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 17:28:10,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 17:28:10,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 17:28:10,409 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 18:19:37,717 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 18:22:54,684 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 18:28:10,410 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-17 18:28:10,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 18:28:10,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 18:28:10,412 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 18:28:10,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 18:28:10,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 18:28:10,414 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 19:28:10,415 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-17 19:28:10,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 19:28:10,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 19:28:10,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 19:28:10,418 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 19:28:10,418 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 19:28:10,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 19:35:07,583 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 20:28:10,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2014-09-17 20:28:10,421 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 20:28:10,422 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 20:28:10,422 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 20:28:10,424 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 20:28:10,424 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 20:28:10,425 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 21:27:59,262 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 21:28:10,426 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-17 21:28:10,427 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 21:28:10,428 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 21:28:10,428 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 21:28:10,429 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 21:28:10,429 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 21:28:10,430 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 21:36:49,570 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 21:38:50,757 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 22:28:05,014 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 22:28:10,431 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-17 22:28:10,432 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 22:28:10,433 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 22:28:10,433 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 22:28:10,434 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 22:28:10,434 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 22:28:10,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 22:37:55,709 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-17 23:28:10,436 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-17 23:28:10,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-17 23:28:10,438 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-17 23:28:10,438 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-17 23:28:10,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-17 23:28:10,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 23:28:10,440 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-17 23:37:46,370 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 00:27:15,537 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 00:28:10,441 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-18 00:28:10,442 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 00:28:10,444 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 00:28:10,444 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 00:28:10,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 00:28:10,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 00:28:10,446 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 00:50:13,871 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 01:28:10,448 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-18 01:28:10,449 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 01:28:10,451 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 01:28:10,451 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 01:28:10,452 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 01:28:10,452 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 01:28:10,453 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 01:48:48,865 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 02:09:31,364 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 02:28:10,454 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-18 02:28:10,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 02:28:10,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 02:28:10,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 02:28:10,458 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 02:28:10,458 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 02:28:10,459 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 03:28:10,460 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-18 03:28:10,463 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 03:28:10,464 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 03:28:10,464 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 03:28:10,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 03:28:10,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 03:28:10,466 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-83) Start deleteAgedOutAuditLogs >2014-09-18 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-83) Finished deleteAgedOutAuditLogs >2014-09-18 04:28:10,466 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-18 04:28:10,468 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 04:28:10,469 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 04:28:10,469 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 04:28:10,470 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 04:28:10,470 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 04:28:10,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 05:28:10,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-18 05:28:10,472 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 05:28:10,473 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 05:28:10,473 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 05:28:10,474 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 05:28:10,474 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 05:28:10,475 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 06:00:32,607 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 06:28:10,476 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-18 06:28:10,477 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 06:28:10,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 06:28:10,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 06:28:10,480 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 06:28:10,480 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 06:28:10,481 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 07:03:09,841 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 07:28:10,482 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-18 07:28:10,483 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 07:28:10,493 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 07:28:10,493 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 07:28:10,494 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 07:28:10,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 07:28:10,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 08:28:10,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-18 08:28:10,496 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 08:28:10,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 08:28:10,497 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 08:28:10,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 08:28:10,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 08:28:10,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 08:44:09,112 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 09:00:45,803 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 09:28:10,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-18 09:28:10,501 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 09:28:10,502 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 09:28:10,502 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 09:28:10,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 09:28:10,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 09:28:10,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 09:37:25,996 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 09:41:58,634 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 10:28:10,504 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-18 10:28:10,505 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 10:28:10,506 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 10:28:10,507 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 10:28:10,508 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 10:28:10,508 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 10:28:10,509 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 10:45:35,946 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 10:48:37,694 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 11:28:10,510 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-18 11:28:10,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 11:28:10,512 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 11:28:10,512 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 11:28:10,513 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 11:28:10,513 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 11:28:10,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 12:28:10,515 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-18 12:28:10,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 12:28:10,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 12:28:10,517 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 12:28:10,518 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 12:28:10,518 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 12:28:10,519 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 13:14:02,110 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 13:28:10,520 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-18 13:28:10,521 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 13:28:10,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 13:28:10,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 13:28:10,523 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 13:28:10,523 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 13:28:10,524 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 13:41:18,073 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 14:28:10,525 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-09-18 14:28:10,526 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 14:28:10,527 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 14:28:10,527 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 14:28:10,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 14:28:10,528 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 14:28:10,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 15:28:10,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-18 15:28:10,531 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 15:28:10,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 15:28:10,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 15:28:10,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 15:28:10,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 15:28:10,534 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 16:28:10,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-18 16:28:10,536 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 16:28:10,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 16:28:10,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 16:28:10,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 16:28:10,538 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 16:28:10,539 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 17:18:26,560 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 17:28:10,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-18 17:28:10,541 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 17:28:10,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 17:28:10,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 17:28:10,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 17:28:10,543 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 17:28:10,544 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 18:21:18,899 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 18:28:07,910 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 18:28:10,545 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-18 18:28:10,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 18:28:10,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 18:28:10,547 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 18:28:10,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 18:28:10,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 18:28:10,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 19:15:51,402 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 19:28:10,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-18 19:28:10,550 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 19:28:10,551 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 19:28:10,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 19:28:10,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 19:28:10,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 19:28:10,554 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 19:28:44,035 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 20:28:10,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-18 20:28:10,556 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 20:28:10,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 20:28:10,557 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 20:28:10,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 20:28:10,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 20:28:10,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 21:00:24,296 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 21:02:55,815 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 21:13:01,887 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 21:28:10,559 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-18 21:28:10,562 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 21:28:10,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 21:28:10,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 21:28:10,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 21:28:10,564 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 21:28:10,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 21:37:16,613 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 22:28:10,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-09-18 22:28:10,566 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 22:28:10,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 22:28:10,568 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 22:28:10,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 22:28:10,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 22:28:10,570 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 22:42:09,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-18 23:28:10,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-18 23:28:10,572 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-18 23:28:10,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-18 23:28:10,574 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update template OVFs in Data Center Default_foobar >2014-09-18 23:28:10,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-18 23:28:10,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 23:28:10,576 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-18 23:57:23,663 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 00:05:58,895 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 00:10:16,375 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 00:12:02,497 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 00:28:10,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-19 00:28:10,578 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 00:28:10,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 00:28:10,579 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 00:28:10,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 00:28:10,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 00:28:10,581 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 00:28:57,412 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 01:12:07,615 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 01:28:10,582 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-19 01:28:10,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 01:28:10,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 01:28:10,584 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 01:28:10,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 01:28:10,585 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 01:28:10,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 02:15:14,539 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 02:20:32,697 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 02:28:10,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-19 02:28:10,589 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 02:28:10,590 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 02:28:10,590 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 02:28:10,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 02:28:10,591 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 02:28:10,592 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 02:31:39,197 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 03:28:10,593 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-19 03:28:10,594 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 03:28:10,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 03:28:10,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 03:28:10,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 03:28:10,597 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 03:28:10,598 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-44) Start deleteAgedOutAuditLogs >2014-09-19 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-44) Finished deleteAgedOutAuditLogs >2014-09-19 03:38:03,265 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 04:28:02,485 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 04:28:10,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-19 04:28:10,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 04:28:10,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 04:28:10,602 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 04:28:10,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 04:28:10,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 04:28:10,604 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 04:30:03,666 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 04:41:10,230 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 05:28:10,605 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-19 05:28:10,606 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 05:28:10,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 05:28:10,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 05:28:10,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 05:28:10,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 05:28:10,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 06:07:00,641 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 06:09:01,819 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 06:28:10,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VMs/Templates Ovf. >2014-09-19 06:28:10,611 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 06:28:10,614 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 06:28:10,614 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 06:28:10,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 06:28:10,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 06:28:10,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 07:28:10,618 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-09-19 07:28:10,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 07:28:10,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 07:28:10,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 07:28:10,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 07:28:10,622 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 07:28:10,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 07:49:00,404 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 08:28:10,624 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-19 08:28:10,625 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 08:28:10,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 08:28:10,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 08:28:10,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 08:28:10,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 08:28:10,628 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 08:35:13,344 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 08:42:47,743 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 09:28:10,630 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-19 09:28:10,631 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 09:28:10,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 09:28:10,632 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 09:28:10,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 09:28:10,634 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 09:28:10,635 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 10:28:10,636 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-19 10:28:10,638 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 10:28:10,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 10:28:10,640 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 10:28:10,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 10:28:10,641 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 10:28:10,642 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 10:31:51,865 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 11:28:10,644 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-19 11:28:10,645 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 11:28:10,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 11:28:10,646 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 11:28:10,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 11:28:10,647 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 11:28:10,648 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 12:16:54,012 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 12:28:10,648 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-19 12:28:10,650 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 12:28:10,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 12:28:10,651 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 12:28:10,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 12:28:10,652 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 12:28:10,653 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 12:37:20,964 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 13:11:25,739 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 13:28:10,654 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-19 13:28:10,655 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 13:28:10,656 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 13:28:10,657 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 13:28:10,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 13:28:10,658 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 13:28:10,659 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 13:30:21,669 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 13:34:54,334 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 13:54:51,268 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 14:28:10,660 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-19 14:28:10,661 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 14:28:10,662 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 14:28:10,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 14:28:10,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 14:28:10,663 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 14:28:10,664 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 15:28:10,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-19 15:28:10,665 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 15:28:10,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 15:28:10,666 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 15:28:10,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 15:28:10,667 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 15:28:10,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 16:28:10,668 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VMs/Templates Ovf. >2014-09-19 16:28:10,669 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 16:28:10,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 16:28:10,672 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 16:28:10,674 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 16:28:10,674 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 16:28:10,675 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 16:31:08,617 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 17:27:57,237 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 17:28:10,676 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-09-19 17:28:10,677 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 17:28:10,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 17:28:10,678 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 17:28:10,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 17:28:10,679 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 17:28:10,680 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 17:41:35,234 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 17:57:29,485 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 18:28:02,240 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 18:28:10,682 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-19 18:28:10,683 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 18:28:10,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 18:28:10,684 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 18:28:10,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 18:28:10,686 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 18:28:10,687 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 18:48:14,231 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 19:28:10,688 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-19 19:28:10,689 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 19:28:10,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 19:28:10,690 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 19:28:10,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 19:28:10,691 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 19:28:10,692 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 19:32:10,517 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 20:02:58,983 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 20:17:52,634 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 20:27:58,614 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 20:28:10,693 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-19 20:28:10,694 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 20:28:10,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 20:28:10,695 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 20:28:10,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 20:28:10,696 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 20:28:10,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 20:29:59,779 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 20:57:31,095 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 21:04:04,880 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 21:08:07,286 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 21:28:10,697 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-09-19 21:28:10,699 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 21:28:10,700 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 21:28:10,701 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 21:28:10,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 21:28:10,702 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 21:28:10,703 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 21:43:12,707 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-39) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 22:25:59,006 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 22:28:10,704 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-19 22:28:10,705 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 22:28:10,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 22:28:10,706 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 22:28:10,707 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 22:28:10,707 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 22:28:10,709 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 23:28:10,710 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-09-19 23:28:10,712 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-19 23:28:10,713 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-19 23:28:10,713 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update template OVFs in Data Center Default_foobar >2014-09-19 23:28:10,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-19 23:28:10,714 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 23:28:10,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-19 23:39:35,901 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-19 23:41:21,905 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 00:07:22,078 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 00:21:24,606 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 00:28:10,715 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-09-20 00:28:10,717 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 00:28:10,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 00:28:10,718 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 00:28:10,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 00:28:10,719 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 00:28:10,720 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 00:30:36,169 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 00:43:28,627 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-7) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 01:01:54,285 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 01:28:10,721 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-20 01:28:10,722 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 01:28:10,723 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 01:28:10,723 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 01:28:10,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 01:28:10,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 01:28:10,724 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 02:28:10,726 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-09-20 02:28:10,727 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 02:28:10,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 02:28:10,729 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 02:28:10,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 02:28:10,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 02:28:10,730 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 02:32:47,766 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 03:19:30,404 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 03:28:10,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-09-20 03:28:10,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 03:28:10,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 03:28:10,734 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 03:28:10,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 03:28:10,736 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 03:28:10,737 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Start deleteAgedOutAuditLogs >2014-09-20 03:35:35,004 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-55) Finished deleteAgedOutAuditLogs >2014-09-20 04:28:10,738 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-20 04:28:10,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 04:28:10,741 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 04:28:10,741 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 04:28:10,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 04:28:10,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 04:28:10,743 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 04:53:56,695 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 05:28:10,744 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-20 05:28:10,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 05:28:10,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 05:28:10,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 05:28:10,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 05:28:10,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 05:28:10,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 06:28:10,747 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-20 06:28:10,748 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 06:28:10,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 06:28:10,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 06:28:10,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 06:28:10,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 06:28:10,751 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 07:27:42,436 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 07:28:10,752 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-20 07:28:10,753 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 07:28:10,755 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 07:28:10,756 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 07:28:10,757 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 07:28:10,757 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 07:28:10,757 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 07:36:56,811 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 07:47:09,338 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 08:08:52,068 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 08:28:10,759 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-20 08:28:10,760 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 08:28:10,761 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 08:28:10,761 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 08:28:10,762 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 08:28:10,762 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 08:28:10,763 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 09:27:38,517 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 09:28:10,764 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-20 09:28:10,765 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 09:28:10,766 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 09:28:10,766 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 09:28:10,767 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 09:28:10,768 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 09:28:10,768 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 09:33:26,888 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 09:40:31,137 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 10:28:10,770 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-20 10:28:10,771 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 10:28:10,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 10:28:10,772 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 10:28:10,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 10:28:10,773 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 10:28:10,774 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 11:28:10,775 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-20 11:28:10,776 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 11:28:10,777 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 11:28:10,777 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 11:28:10,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 11:28:10,778 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 11:28:10,779 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 12:12:15,443 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 12:15:20,219 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 12:28:10,779 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-09-20 12:28:10,780 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 12:28:10,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 12:28:10,781 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 12:28:10,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 12:28:10,782 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 12:28:10,783 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 12:32:42,630 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 12:56:11,505 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 13:28:10,784 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-20 13:28:10,785 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 13:28:10,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 13:28:10,787 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 13:28:10,788 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 13:28:10,788 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 13:28:10,789 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 13:37:35,971 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 14:04:36,769 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 14:28:10,790 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-20 14:28:10,792 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 14:28:10,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 14:28:10,793 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 14:28:10,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 14:28:10,794 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 14:28:10,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 15:28:10,795 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-20 15:28:10,797 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 15:28:10,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 15:28:10,798 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 15:28:10,799 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 15:28:10,799 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 15:28:10,800 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 15:51:40,784 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 16:07:35,078 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 16:13:53,667 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 16:28:10,801 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-09-20 16:28:10,802 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 16:28:10,803 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 16:28:10,803 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 16:28:10,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 16:28:10,804 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 16:28:10,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 17:05:54,558 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 17:28:10,805 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-20 17:28:10,807 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 17:28:10,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 17:28:10,808 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 17:28:10,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 17:28:10,809 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 17:28:10,810 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 17:45:02,701 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 18:15:36,082 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 18:28:10,811 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-20 18:28:10,812 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 18:28:10,813 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 18:28:10,813 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 18:28:10,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 18:28:10,814 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 18:28:10,815 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 19:08:06,926 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 19:28:10,815 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-20 19:28:10,816 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 19:28:10,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 19:28:10,818 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 19:28:10,819 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 19:28:10,819 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 19:28:10,819 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 20:28:10,820 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-20 20:28:10,821 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 20:28:10,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 20:28:10,822 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 20:28:10,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 20:28:10,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 20:28:10,823 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 20:49:51,939 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 21:28:10,824 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-20 21:28:10,827 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 21:28:10,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 21:28:10,828 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 21:28:10,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 21:28:10,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 21:28:10,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 21:33:48,029 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 21:34:33,467 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 22:18:59,916 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-46) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 22:28:10,829 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-20 22:28:10,831 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 22:28:10,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 22:28:10,832 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 22:28:10,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 22:28:10,833 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 22:28:10,834 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 22:34:39,402 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-20) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 22:38:26,577 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-20 23:28:10,835 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-09-20 23:28:10,836 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-20 23:28:10,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-20 23:28:10,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update template OVFs in Data Center Default_foobar >2014-09-20 23:28:10,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-20 23:28:10,837 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-20 23:28:10,838 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 00:16:09,002 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 00:20:26,567 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 00:28:10,839 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-21 00:28:10,840 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 00:28:10,841 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 00:28:10,842 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 00:28:10,842 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 00:28:10,843 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 00:28:10,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 00:28:46,458 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 01:16:14,621 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 01:28:10,844 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VMs/Templates Ovf. >2014-09-21 01:28:10,846 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 01:28:10,847 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 01:28:10,847 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 01:28:10,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 01:28:10,848 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 01:28:10,849 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 02:28:10,850 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-21 02:28:10,852 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 02:28:10,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 02:28:10,853 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 02:28:10,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 02:28:10,854 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 02:28:10,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 03:28:10,855 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-21 03:28:10,857 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 03:28:10,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 03:28:10,858 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 03:28:10,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 03:28:10,859 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 03:28:10,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-39) Start deleteAgedOutAuditLogs >2014-09-21 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-39) Finished deleteAgedOutAuditLogs >2014-09-21 04:28:10,860 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-21 04:28:10,865 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 04:28:10,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 04:28:10,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 04:28:10,866 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 04:28:10,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 04:28:10,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 05:28:10,867 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-21 05:28:10,868 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 05:28:10,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 05:28:10,870 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 05:28:10,871 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 05:28:10,871 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 05:28:10,872 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 06:15:26,212 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 06:28:10,873 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-21 06:28:10,874 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 06:28:10,876 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 06:28:10,876 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 06:28:10,877 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 06:28:10,877 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 06:28:10,878 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 07:28:10,879 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-09-21 07:28:10,880 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 07:28:10,887 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 07:28:10,887 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 07:28:10,888 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 07:28:10,888 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 07:28:10,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 08:01:13,437 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 08:19:39,703 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 08:21:10,615 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 08:28:10,889 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VMs/Templates Ovf. >2014-09-21 08:28:10,891 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 08:28:10,892 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 08:28:10,892 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 08:28:10,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 08:28:10,893 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 08:28:10,894 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-16) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 09:28:10,895 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-21 09:28:10,896 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 09:28:10,897 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 09:28:10,897 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 09:28:10,906 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 09:28:10,906 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 09:28:10,907 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 09:30:36,521 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 09:54:35,971 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 10:18:50,814 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 10:21:07,251 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-5) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 10:28:10,909 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-21 10:28:10,910 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 10:28:10,912 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 10:28:10,912 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 10:28:10,913 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 10:28:10,913 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 10:28:10,914 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 10:34:15,053 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 11:28:10,915 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-09-21 11:28:10,916 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 11:28:10,918 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 11:28:10,918 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 11:28:10,919 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 11:28:10,919 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 11:28:10,920 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 11:29:59,373 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 11:45:11,213 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 11:54:31,478 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 12:28:10,921 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-21 12:28:10,922 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 12:28:10,923 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 12:28:10,924 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 12:28:10,925 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 12:28:10,925 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 12:28:10,925 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 13:28:10,926 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-21 13:28:10,927 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 13:28:10,929 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 13:28:10,929 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 13:28:10,930 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 13:28:10,930 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 13:28:10,931 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 13:34:45,066 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 14:28:10,931 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-21 14:28:10,932 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 14:28:10,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 14:28:10,933 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 14:28:10,934 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 14:28:10,934 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 14:28:10,935 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 15:24:19,893 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-2) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 15:28:10,935 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-09-21 15:28:10,937 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 15:28:10,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 15:28:10,938 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 15:28:10,939 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 15:28:10,939 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 15:28:10,940 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 15:57:39,720 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 16:16:23,859 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 16:28:10,940 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-21 16:28:10,942 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 16:28:10,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 16:28:10,943 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 16:28:10,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 16:28:10,944 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 16:28:10,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 16:32:00,019 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 16:47:54,511 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 17:28:10,945 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-09-21 17:28:10,947 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 17:28:10,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 17:28:10,949 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 17:28:10,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 17:28:10,950 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 17:28:10,951 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 17:47:14,307 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 17:50:46,404 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-27) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 18:10:27,977 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-9) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 18:26:37,360 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 18:28:10,952 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-21 18:28:10,953 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 18:28:10,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 18:28:10,954 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 18:28:10,955 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 18:28:10,955 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 18:28:10,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 18:29:08,792 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 18:34:26,871 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-1) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 18:54:54,029 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-25) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 19:28:10,956 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VMs/Templates Ovf. >2014-09-21 19:28:10,958 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 19:28:10,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 19:28:10,960 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 19:28:10,961 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 19:28:10,962 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 19:28:10,963 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-83) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 19:33:01,106 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-43) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 19:53:13,002 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 20:28:10,963 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VMs/Templates Ovf. >2014-09-21 20:28:10,965 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 20:28:10,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 20:28:10,966 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 20:28:10,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 20:28:10,967 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 20:28:10,968 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-39) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 20:43:57,443 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 20:47:59,804 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 21:28:10,968 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-21 21:28:10,970 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 21:28:10,971 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 21:28:10,971 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 21:28:10,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 21:28:10,972 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 21:28:10,973 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 22:28:10,974 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-21 22:28:10,975 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 22:28:10,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 22:28:10,977 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 22:28:10,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 22:28:10,978 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 22:28:10,979 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 22:36:34,231 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 22:37:50,012 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 23:28:04,888 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-21 23:28:10,980 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-21 23:28:10,981 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-21 23:28:10,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-21 23:28:10,983 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update template OVFs in Data Center Default_foobar >2014-09-21 23:28:10,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-21 23:28:10,984 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-21 23:28:10,985 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 00:02:25,020 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-23) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 00:06:57,682 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 00:13:28,525 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 00:28:10,985 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-22 00:28:10,987 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 00:28:10,988 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 00:28:10,988 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 00:28:10,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 00:28:10,989 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 00:28:10,990 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 00:32:58,466 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 01:23:43,241 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 01:28:10,991 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VMs/Templates Ovf. >2014-09-22 01:28:10,992 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 01:28:10,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 01:28:10,993 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 01:28:10,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 01:28:10,994 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 01:28:10,995 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 02:28:10,995 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-22 02:28:10,997 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 02:28:10,998 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 02:28:10,998 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 02:28:10,999 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 02:28:10,999 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 02:28:11,000 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 03:16:50,423 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 03:22:54,021 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 03:28:11,000 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-22 03:28:11,002 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 03:28:11,003 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 03:28:11,003 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 03:28:11,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 03:28:11,004 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 03:28:11,005 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-97) Start deleteAgedOutAuditLogs >2014-09-22 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-97) Finished deleteAgedOutAuditLogs >2014-09-22 03:58:29,815 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 04:28:11,006 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-22 04:28:11,007 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 04:28:11,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 04:28:11,008 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 04:28:11,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 04:28:11,009 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 04:28:11,010 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 05:28:11,011 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-22 05:28:11,012 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 05:28:11,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 05:28:11,013 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 05:28:11,014 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 05:28:11,014 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 05:28:11,015 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 06:28:11,016 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2014-09-22 06:28:11,017 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 06:28:11,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 06:28:11,019 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 06:28:11,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 06:28:11,020 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 06:28:11,021 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 07:28:11,022 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-22 07:28:11,024 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 07:28:11,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 07:28:11,025 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 07:28:11,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 07:28:11,026 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 07:28:11,027 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 07:52:33,635 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-12) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 08:08:43,400 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-26) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 08:21:35,917 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 08:28:11,028 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-22 08:28:11,029 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 08:28:11,030 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 08:28:11,030 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 08:28:11,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 08:28:11,031 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 08:28:11,032 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 09:28:11,033 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-22 09:28:11,034 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 09:28:11,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 09:28:11,035 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 09:28:11,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 09:28:11,036 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 09:28:11,037 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 09:36:35,352 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 10:28:11,038 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-22 10:28:11,039 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 10:28:11,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 10:28:11,040 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 10:28:11,041 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 10:28:11,041 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 10:28:11,042 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 10:50:49,158 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 11:28:11,043 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-22 11:28:11,044 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 11:28:11,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 11:28:11,045 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 11:28:11,046 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 11:28:11,047 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 11:28:11,048 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 11:56:12,612 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-33) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 12:03:01,664 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 12:28:11,050 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-22 12:28:11,051 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 12:28:11,053 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 12:28:11,053 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 12:28:11,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 12:28:11,054 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 12:28:11,066 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 13:28:11,067 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-22 13:28:11,068 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 13:28:11,070 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 13:28:11,070 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 13:28:11,071 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 13:28:11,071 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 13:28:11,072 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 13:56:39,303 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 14:28:11,072 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-22 14:28:11,074 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 14:28:11,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 14:28:11,076 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 14:28:11,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 14:28:11,077 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 14:28:11,078 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 14:34:31,354 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-37) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 15:28:11,079 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-09-22 15:28:11,081 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 15:28:11,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 15:28:11,082 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 15:28:11,083 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 15:28:11,083 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 15:28:11,084 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 16:28:11,084 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-22 16:28:11,086 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 16:28:11,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 16:28:11,087 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 16:28:11,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 16:28:11,088 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 16:28:11,089 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 17:28:11,090 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-22 17:28:11,091 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 17:28:11,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 17:28:11,092 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 17:28:11,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 17:28:11,093 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 17:28:11,094 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 17:55:31,419 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-31) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 17:58:48,392 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-47) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 18:01:50,130 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 18:28:11,094 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-22 18:28:11,095 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 18:28:11,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 18:28:11,097 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 18:28:11,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 18:28:11,098 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 18:28:11,099 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 18:32:53,644 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 18:43:30,230 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 18:51:04,893 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 19:22:53,393 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-6) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 19:28:11,099 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-22 19:28:11,101 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 19:28:11,102 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 19:28:11,102 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 19:28:11,103 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 19:28:11,103 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 19:28:11,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 20:13:08,119 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-48) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 20:15:09,283 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 20:28:11,104 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-09-22 20:28:11,105 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 20:28:11,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 20:28:11,106 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 20:28:11,107 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 20:28:11,107 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 20:28:11,108 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 20:38:22,948 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-38) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 21:28:11,108 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-22 21:28:11,109 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 21:28:11,111 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 21:28:11,111 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 21:28:11,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 21:28:11,112 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 21:28:11,113 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 22:28:11,113 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-22 22:28:11,114 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 22:28:11,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 22:28:11,117 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 22:28:11,118 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 22:28:11,118 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 22:28:11,119 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 22:40:51,150 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 23:13:55,634 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 23:28:11,120 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-22 23:28:11,121 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-22 23:28:11,123 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-22 23:28:11,123 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-22 23:28:11,124 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-22 23:28:11,124 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 23:28:11,125 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-22 23:28:34,347 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-22 23:52:49,734 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 00:28:11,126 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-23 00:28:11,127 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 00:28:11,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 00:28:11,128 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 00:28:11,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 00:28:11,129 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 00:28:11,130 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 01:00:44,981 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 01:28:11,131 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-23 01:28:11,132 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 01:28:11,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 01:28:11,133 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 01:28:11,134 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 01:28:11,134 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 01:28:11,135 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 01:41:54,123 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 02:28:11,136 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-23 02:28:11,137 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 02:28:11,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 02:28:11,138 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 02:28:11,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 02:28:11,139 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 02:28:11,140 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 03:28:11,140 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-23 03:28:11,141 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 03:28:11,142 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 03:28:11,142 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 03:28:11,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 03:28:11,143 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 03:28:11,144 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-30) Start deleteAgedOutAuditLogs >2014-09-23 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-30) Finished deleteAgedOutAuditLogs >2014-09-23 03:51:56,262 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-44) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 04:28:11,145 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-09-23 04:28:11,146 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 04:28:11,147 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 04:28:11,148 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 04:28:11,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 04:28:11,149 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 04:28:11,150 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 04:46:13,530 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 05:28:11,150 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-23 05:28:11,152 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 05:28:11,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 05:28:11,153 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 05:28:11,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 05:28:11,154 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 05:28:11,155 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 06:28:11,156 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-23 06:28:11,158 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 06:28:11,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 06:28:11,159 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 06:28:11,160 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 06:28:11,160 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 06:28:11,161 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 07:28:11,162 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-23 07:28:11,163 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 07:28:11,165 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 07:28:11,165 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 07:28:11,166 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 07:28:11,166 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 07:28:11,167 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 08:06:41,250 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-21) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 08:28:11,167 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-23 08:28:11,169 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 08:28:11,170 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 08:28:11,170 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 08:28:11,171 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 08:28:11,171 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 08:28:11,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 09:28:11,172 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-23 09:28:11,174 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 09:28:11,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 09:28:11,175 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 09:28:11,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 09:28:11,176 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 09:28:11,177 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 09:46:58,963 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 10:28:11,178 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-23 10:28:11,179 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 10:28:11,180 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 10:28:11,181 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 10:28:11,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 10:28:11,182 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 10:28:11,183 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 10:42:13,574 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 11:28:11,184 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VMs/Templates Ovf. >2014-09-23 11:28:11,185 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 11:28:11,186 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 11:28:11,187 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 11:28:11,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 11:28:11,188 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 11:28:11,189 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-82) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 12:28:11,190 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-09-23 12:28:11,191 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 12:28:11,192 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 12:28:11,192 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 12:28:11,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 12:28:11,193 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 12:28:11,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 12:56:02,864 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 12:59:07,656 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-24) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 13:28:11,194 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-23 13:28:11,196 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 13:28:11,197 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 13:28:11,197 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 13:28:11,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 13:28:11,198 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 13:28:11,199 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 13:29:37,730 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-11) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 14:13:03,152 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 14:14:55,179 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-49) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 14:28:11,199 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-09-23 14:28:11,202 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 14:28:11,203 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 14:28:11,203 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 14:28:11,204 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 14:28:11,204 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 14:28:11,205 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 15:28:11,206 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-23 15:28:11,207 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 15:28:11,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 15:28:11,210 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 15:28:11,211 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 15:28:11,211 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 15:28:11,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 16:10:13,936 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 16:28:11,212 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-23 16:28:11,214 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 16:28:11,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 16:28:11,217 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 16:28:11,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 16:28:11,218 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 16:28:11,219 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 16:56:26,703 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-36) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 17:28:11,220 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VMs/Templates Ovf. >2014-09-23 17:28:11,221 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 17:28:11,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 17:28:11,222 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 17:28:11,223 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 17:28:11,223 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 17:28:11,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 18:20:45,770 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 18:24:48,199 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-34) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 18:28:11,224 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-23 18:28:11,225 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 18:28:11,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 18:28:11,226 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 18:28:11,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 18:28:11,227 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 18:28:11,228 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 18:48:14,257 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 18:53:20,341 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 19:28:11,229 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-23 19:28:11,231 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 19:28:11,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 19:28:11,232 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 19:28:11,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 19:28:11,233 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 19:28:11,234 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 19:56:12,561 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-42) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 20:28:11,235 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-23 20:28:11,236 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 20:28:11,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 20:28:11,238 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 20:28:11,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 20:28:11,239 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 20:28:11,240 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 20:49:14,237 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 21:28:11,241 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-23 21:28:11,242 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 21:28:11,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 21:28:11,243 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 21:28:11,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 21:28:11,244 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 21:28:11,245 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 21:31:48,445 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 21:37:27,883 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-14) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 22:02:27,931 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-18) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 22:19:07,724 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 22:28:11,246 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-23 22:28:11,247 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 22:28:11,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 22:28:11,248 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 22:28:11,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 22:28:11,249 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 22:28:11,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 23:28:11,251 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-23 23:28:11,252 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-23 23:28:11,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-23 23:28:11,253 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update template OVFs in Data Center Default_foobar >2014-09-23 23:28:11,254 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-23 23:28:11,254 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 23:28:11,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-23 23:45:59,170 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-30) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-23 23:59:22,153 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 00:28:11,256 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-09-24 00:28:11,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 00:28:11,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 00:28:11,259 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 00:28:11,260 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 00:28:11,260 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 00:28:11,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 01:28:11,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VMs/Templates Ovf. >2014-09-24 01:28:11,262 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 01:28:11,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 01:28:11,263 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 01:28:11,264 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 01:28:11,264 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 01:28:11,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-95) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 02:28:11,266 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-24 02:28:11,267 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 02:28:11,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 02:28:11,270 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 02:28:11,271 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 02:28:11,271 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 02:28:11,272 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 02:37:11,444 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 02:49:18,788 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-29) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 03:28:11,273 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-24 03:28:11,274 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 03:28:11,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 03:28:11,277 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 03:28:11,278 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 03:28:11,278 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 03:28:11,279 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 03:35:35,009 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Start deleteAgedOutAuditLogs >2014-09-24 03:35:35,011 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-68) Finished deleteAgedOutAuditLogs >2014-09-24 04:16:41,117 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-40) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 04:28:11,280 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-09-24 04:28:11,281 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 04:28:11,283 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 04:28:11,283 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 04:28:11,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 04:28:11,284 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 04:28:11,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 05:28:11,285 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-24 05:28:11,286 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 05:28:11,289 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 05:28:11,290 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 05:28:11,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 05:28:11,291 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 05:28:11,292 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 06:28:11,292 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-24 06:28:11,293 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 06:28:11,294 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 06:28:11,295 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 06:28:11,296 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 06:28:11,296 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 06:28:11,296 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 06:29:45,510 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 06:56:16,303 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-3) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 06:58:32,614 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-15) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 07:28:11,297 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-24 07:28:11,298 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 07:28:11,299 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 07:28:11,300 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 07:28:11,300 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 07:28:11,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 07:28:11,301 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 08:00:39,288 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-22) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 08:10:45,271 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 08:28:11,302 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-24 08:28:11,304 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 08:28:11,305 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 08:28:11,305 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 08:28:11,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 08:28:11,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 08:28:11,306 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 09:17:55,718 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-35) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 09:28:11,308 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-24 09:28:11,309 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VM OVFs in Data Center Default_foobar >2014-09-24 09:28:11,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated VM OVFs in Data Center Default_foobar >2014-09-24 09:28:11,310 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update template OVFs in Data Center Default_foobar >2014-09-24 09:28:11,311 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully updated templates OVFs in Data Center Default_foobar >2014-09-24 09:28:11,311 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to remove unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 09:28:11,312 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Successfully removed unneeded template/vm OVFs in Data Center Default_foobar >2014-09-24 09:48:43,907 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-4) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 09:50:30,044 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-8) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-09-24 10:04:51,506 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2014-09-24 10:04:51,510 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-09-24 10:04:51,561 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginUserCommand internal: false. >2014-09-24 10:04:51,561 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-7) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-09-24 10:04:51,893 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-2) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-09-24 10:05:37,755 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-8) [4e4f924d] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-09-24 10:05:37,786 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-24 10:05:37,789 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] START, SetVdsStatusVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 5bc6f517 >2014-09-24 10:05:37,789 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] VDS blade is spm and moved from up calling resetIrs. >2014-09-24 10:05:37,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] START, ResetIrsVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false, vdsId = 463258f4-94f9-4612-bfc8-139074be69a9, ignoreStopFailed = false), log id: b7c40e4 >2014-09-24 10:05:37,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] START, SpmStopVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135), log id: 43e5e19a >2014-09-24 10:05:37,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] SpmStopVDSCommand::Stopping SPM on vds blade, pool id 00000002-0002-0002-0002-000000000135 >2014-09-24 10:05:38,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] FINISH, SpmStopVDSCommand, log id: 43e5e19a >2014-09-24 10:05:38,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] FINISH, ResetIrsVDSCommand, log id: b7c40e4 >2014-09-24 10:05:38,179 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] FINISH, SetVdsStatusVDSCommand, log id: 5bc6f517 >2014-09-24 10:05:38,181 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 00000002-0002-0002-0002-000000000135 value: POOL >] >2014-09-24 10:05:38,201 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-24 10:05:38,207 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [4e4f924d] Correlation ID: 4e4f924d, Job ID: b718fed3-463a-4681-ba0b-b2e99e726e85, Call Stack: null, Custom Event ID: -1, Message: Host blade was switched to Maintenance mode by admin. >2014-09-24 10:05:39,109 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-64) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 463258f4-94f9-4612-bfc8-139074be69a9 : blade >2014-09-24 10:05:39,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-36) Clearing cache of pool: 00000002-0002-0002-0002-000000000135 for problematic entities of VDS: blade. >2014-09-24 10:05:39,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-64) START, DisconnectStoragePoolVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1), log id: 57131d0b >2014-09-24 10:05:41,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, DisconnectStoragePoolVDSCommand, log id: 57131d0b >2014-09-24 10:05:41,296 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-64) [62335d4b] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-24 10:05:41,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-64) [62335d4b] START, DisconnectStorageServerVDSCommand(HostName = blade, HostId = 463258f4-94f9-4612-bfc8-139074be69a9, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 25ddfe8b >2014-09-24 10:05:41,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-64) [62335d4b] FINISH, DisconnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 25ddfe8b >2014-09-24 10:05:43,013 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-8) Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain dd3c814d-9d43-46ff-8708-52dc8b452a97 status from Active to Unknown, reason : no reporting hosts >2014-09-24 10:05:43,016 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-8) Storage Pool 00000002-0002-0002-0002-000000000135 - Updating Storage Domain 99938ede-8d9a-4f22-99f5-c73771944ded status from Active to Unknown, reason : no reporting hosts >2014-09-24 10:05:43,019 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-8) [35234e2f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-09-24 10:05:43,043 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) [35234e2f] Correlation ID: 35234e2f, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center Default_foobar. Setting status to Non Responsive. >2014-09-24 10:05:43,692 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-4) [5426b3bb] Lock Acquired to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-24 10:05:43,699 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 463258f4-94f9-4612-bfc8-139074be69a9 Type: VDS >2014-09-24 10:05:43,743 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] START, RemoveVdsVDSCommand( HostId = 463258f4-94f9-4612-bfc8-139074be69a9), log id: 5c6bae5e >2014-09-24 10:05:43,743 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] vdsManager::disposing >2014-09-24 10:05:43,744 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] FINISH, RemoveVdsVDSCommand, log id: 5c6bae5e >2014-09-24 10:05:43,747 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] Correlation ID: 5426b3bb, Call Stack: null, Custom Event ID: -1, Message: Host blade was removed by admin. >2014-09-24 10:05:43,748 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (org.ovirt.thread.pool-4-thread-14) [5426b3bb] Lock freed to object EngineLock [exclusiveLocks= key: 463258f4-94f9-4612-bfc8-139074be69a9 value: VDS >, sharedLocks= ] >2014-09-24 10:28:11,314 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-24 10:37:21,531 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [7f1e4587] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-09-24 10:37:21,554 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-09-24 10:37:21,561 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-09-24 10:37:21,563 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] START, RemoveVdsVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 236ab1db >2014-09-24 10:37:21,563 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] FINISH, RemoveVdsVDSCommand, log id: 236ab1db >2014-09-24 10:37:21,565 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] START, AddVdsVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 3dece2c2 >2014-09-24 10:37:21,565 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] AddVds - entered , starting logic to add VDS facf6428-64e1-483e-b942-6adf5fb44742 >2014-09-24 10:37:21,566 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] AddVds - VDS facf6428-64e1-483e-b942-6adf5fb44742 was added, will try to add it to the resource manager >2014-09-24 10:37:21,566 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [54d59dc9] Entered VdsManager constructor >2014-09-24 10:37:21,579 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [54d59dc9] Initialize vdsBroker (dell-r210ii-16.rhev.lab.eng.brq.redhat.com,54,321) >2014-09-24 10:37:21,580 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [54d59dc9] VDS facf6428-64e1-483e-b942-6adf5fb44742 was added to the Resource Manager >2014-09-24 10:37:21,580 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [54d59dc9] FINISH, AddVdsVDSCommand, log id: 3dece2c2 >2014-09-24 10:37:21,585 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [54d59dc9] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-09-24 10:37:21,604 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Lock Acquired to object EngineLock [exclusiveLocks= key: facf6428-64e1-483e-b942-6adf5fb44742 value: VDS >, sharedLocks= ] >2014-09-24 10:37:21,607 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [54d59dc9] Correlation ID: 7f1e4587, Job ID: 951d113d-3767-4893-9efd-19590a46dfb7, Call Stack: null, Custom Event ID: -1, Message: Host rack was added by admin. >2014-09-24 10:37:21,612 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Running command: InstallVdsCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-09-24 10:37:21,612 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Before Installation host facf6428-64e1-483e-b942-6adf5fb44742, rack >2014-09-24 10:37:21,615 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] START, SetVdsStatusVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 7c2cdd9c >2014-09-24 10:37:21,619 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] FINISH, SetVdsStatusVDSCommand, log id: 7c2cdd9c >2014-09-24 10:37:21,700 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Connected to host dell-r210ii-16.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 97:93:e2:1d:85:b0:85:66:85:45:96:80:f0:0b:38:73 >2014-09-24 10:37:21,707 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Connected to host dell-r210ii-16.rhev.lab.eng.brq.redhat.com with SSH key fingerprint: 97:93:e2:1d:85:b0:85:66:85:45:96:80:f0:0b:38:73. >2014-09-24 10:37:21,737 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Installation of dell-r210ii-16.rhev.lab.eng.brq.redhat.com. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-09-24 10:37:21,751 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-46) SSH execute root@dell-r210ii-16.rhev.lab.eng.brq.redhat.com 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-09-24 10:37:22,758 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Initializing >2014-09-24 10:37:22,765 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Initializing. >2014-09-24 10:37:22,776 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Environment setup >2014-09-24 10:37:22,784 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment setup. >2014-09-24 10:37:22,787 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Environment packages setup >2014-09-24 10:37:22,793 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment packages setup. >2014-09-24 10:37:24,583 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-92) Initializing Host: rack >2014-09-24 10:37:32,980 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Programs detection >2014-09-24 10:37:32,987 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Programs detection. >2014-09-24 10:37:32,987 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Environment customization >2014-09-24 10:37:32,992 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Environment customization. >2014-09-24 10:37:33,013 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Logs at host located at: '/tmp/ovirt-host-deploy-20140924103722-z6tuto.log' >2014-09-24 10:37:33,019 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Logs at host located at: '/tmp/ovirt-host-deploy-20140924103722-z6tuto.log'. >2014-09-24 10:37:33,055 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host dell-r210ii-16.rhev.lab.eng.brq.redhat.com reports unique id 4C4C4544-0034-5310-8052-B4C04F4A354A >2014-09-24 10:37:33,080 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0034-5310-8052-B4C04F4A354A to Host dell-r210ii-16.rhev.lab.eng.brq.redhat.com >2014-09-24 10:37:33,141 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Setup validation >2014-09-24 10:37:33,147 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Setup validation. >2014-09-24 10:37:33,183 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Hardware supports virtualization >2014-09-24 10:37:33,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Hardware supports virtualization. >2014-09-24 10:37:33,546 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Transaction setup >2014-09-24 10:37:33,552 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Transaction setup. >2014-09-24 10:37:33,591 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-24 10:37:33,604 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Misc configuration. >2014-09-24 10:37:33,604 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Package installation >2014-09-24 10:37:33,610 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Package installation. >2014-09-24 10:37:40,930 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Status: Downloading Packages >2014-09-24 10:37:40,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Status: Downloading Packages. >2014-09-24 10:37:42,564 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Download/Verify: 2:qemu-kvm-rhev-tools-0.12.1.2-2.447.el6.x86_64 >2014-09-24 10:37:42,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Download/Verify: 2:qemu-kvm-rhev-tools-0.12.1.2-2.447.el6.x86_64. >2014-09-24 10:37:42,571 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Status: Check Package Signatures >2014-09-24 10:37:42,576 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Status: Check Package Signatures. >2014-09-24 10:37:42,576 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Status: Running Test Transaction >2014-09-24 10:37:42,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Status: Running Test Transaction. >2014-09-24 10:37:42,643 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Status: Running Transaction >2014-09-24 10:37:42,649 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Status: Running Transaction. >2014-09-24 10:37:42,874 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum update: 1/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.447.el6.x86_64 >2014-09-24 10:37:42,881 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum update: 1/2: 2:qemu-kvm-rhev-tools-0.12.1.2-2.447.el6.x86_64. >2014-09-24 10:37:43,195 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum updated: 2/2: qemu-kvm-rhev-tools >2014-09-24 10:37:43,201 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum updated: 2/2: qemu-kvm-rhev-tools. >2014-09-24 10:37:48,105 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.447.el6 - u >2014-09-24 10:37:48,112 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Verify: 1/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.447.el6 - u. >2014-09-24 10:37:48,208 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Yum Verify: 2/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.446.el6 - ud >2014-09-24 10:37:48,218 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Yum Verify: 2/2: qemu-kvm-rhev-tools.x86_64 2:0.12.1.2-2.446.el6 - ud. >2014-09-24 10:37:48,312 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Misc configuration >2014-09-24 10:37:48,318 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Misc configuration. >2014-09-24 10:37:49,390 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Enrolling certificate >2014-09-24 10:37:49,396 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Enrolling certificate. >2014-09-24 10:37:54,694 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Transaction commit >2014-09-24 10:37:54,703 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Transaction commit. >2014-09-24 10:37:54,841 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Closing up >2014-09-24 10:37:54,847 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Closing up. >2014-09-24 10:37:55,825 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stopping libvirtd >2014-09-24 10:37:55,831 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stopping libvirtd. >2014-09-24 10:37:56,192 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Starting vdsm >2014-09-24 10:37:56,198 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Starting vdsm. >2014-09-24 10:37:58,375 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Pre-termination >2014-09-24 10:37:58,381 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Pre-termination. >2014-09-24 10:37:58,400 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140924103758-dell-r210ii-16.rhev.lab.eng.brq.redhat.com-784c2bd7.log' >2014-09-24 10:37:58,407 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140924103758-dell-r210ii-16.rhev.lab.eng.brq.redhat.com-784c2bd7.log'. >2014-09-24 10:37:58,622 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation dell-r210ii-16.rhev.lab.eng.brq.redhat.com: Stage: Termination >2014-09-24 10:37:58,628 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 784c2bd7, Call Stack: null, Custom Event ID: -1, Message: Installing Host rack. Stage: Termination. >2014-09-24 10:37:58,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-09-24 10:37:58,770 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Command PollVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-09-24 10:37:59,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-09-24 10:37:59,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Command PollVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-09-24 10:37:59,866 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Engine managed to communicate with VDSM agent on host rack >2014-09-24 10:38:00,245 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] START, SetVdsStatusVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4157325 >2014-09-24 10:38:00,249 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] FINISH, SetVdsStatusVDSCommand, log id: 4157325 >2014-09-24 10:38:00,249 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] After Installation host rack, VDS >2014-09-24 10:38:00,255 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Correlation ID: 784c2bd7, Job ID: 951d113d-3767-4893-9efd-19590a46dfb7, Call Stack: null, Custom Event ID: -1, Message: Host rack installed >2014-09-24 10:38:00,263 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-46) [784c2bd7] Lock freed to object EngineLock [exclusiveLocks= key: facf6428-64e1-483e-b942-6adf5fb44742 value: VDS >, sharedLocks= ] >2014-09-24 10:38:00,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GetHardwareInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]), log id: 3fdf28fe >2014-09-24 10:38:00,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GetHardwareInfoVDSCommand, log id: 3fdf28fe >2014-09-24 10:38:00,767 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-7) [39aeb46e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-09-24 10:38:00,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [39aeb46e] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]), log id: 52b6d71b >2014-09-24 10:38:00,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-7) [39aeb46e] FINISH, GetHardwareInfoVDSCommand, log id: 52b6d71b >2014-09-24 10:38:00,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [39aeb46e] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host rack. >2014-09-24 10:38:00,915 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-7) [a14845c] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-09-24 10:38:00,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-7) [a14845c] START, SetMOMPolicyParametersVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 4b236002 >2014-09-24 10:38:01,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-7) [a14845c] FINISH, SetMOMPolicyParametersVDSCommand, log id: 4b236002 >2014-09-24 10:38:01,020 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-7) [a14845c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-09-24 10:38:01,027 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-7) [399d1d80] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-09-24 10:38:01,031 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-7) [6491c42a] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-09-24 11:28:11,316 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-24 12:28:11,318 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-24 13:28:11,320 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-24 14:28:11,322 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-24 15:28:11,323 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-24 16:28:11,325 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-24 17:28:11,327 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-24 18:28:11,328 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-24 19:28:11,330 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-78) Attempting to update VMs/Templates Ovf. >2014-09-24 20:28:11,332 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-48) Attempting to update VMs/Templates Ovf. >2014-09-24 21:28:11,333 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-24 22:28:11,334 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-66) Attempting to update VMs/Templates Ovf. >2014-09-24 23:28:11,336 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-10) Attempting to update VMs/Templates Ovf. >2014-09-25 00:28:11,337 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-25 01:28:11,339 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-74) Attempting to update VMs/Templates Ovf. >2014-09-25 02:28:11,341 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-09-25 03:28:11,342 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-21) Attempting to update VMs/Templates Ovf. >2014-09-25 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-18) Start deleteAgedOutAuditLogs >2014-09-25 03:35:35,015 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-18) Finished deleteAgedOutAuditLogs >2014-09-25 04:28:11,343 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-17) Attempting to update VMs/Templates Ovf. >2014-09-25 05:28:11,344 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-25 06:28:11,347 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-25 07:28:11,349 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-25 08:28:11,351 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2014-09-25 09:28:11,352 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-25 10:28:11,354 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-25 11:28:11,357 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-25 12:28:11,358 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2014-09-25 13:28:11,361 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-25 14:28:11,362 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-20) Attempting to update VMs/Templates Ovf. >2014-09-25 15:28:11,363 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-25 16:28:11,365 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-25 17:28:11,367 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-25 18:28:11,369 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-49) Attempting to update VMs/Templates Ovf. >2014-09-25 19:28:11,371 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-25 20:28:11,373 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-90) Attempting to update VMs/Templates Ovf. >2014-09-25 21:28:11,374 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-25 22:28:11,376 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-09-25 23:28:11,379 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-77) Attempting to update VMs/Templates Ovf. >2014-09-26 00:28:11,380 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-26 01:28:11,382 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-26 02:28:11,384 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-26 03:28:11,386 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-84) Attempting to update VMs/Templates Ovf. >2014-09-26 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Start deleteAgedOutAuditLogs >2014-09-26 03:35:35,008 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-99) [1602b4dd] Finished deleteAgedOutAuditLogs >2014-09-26 04:28:11,387 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-26 05:28:11,388 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-26 06:28:11,390 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-09-26 07:28:11,391 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-26 08:28:11,393 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-09-26 09:28:11,394 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-31) Attempting to update VMs/Templates Ovf. >2014-09-26 10:28:11,397 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-26 11:28:11,398 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) [35234e2f] Attempting to update VMs/Templates Ovf. >2014-09-26 12:28:11,401 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-26 13:28:11,402 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-76) Attempting to update VMs/Templates Ovf. >2014-09-26 14:28:11,404 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-09-26 15:28:11,406 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-09-26 16:28:11,408 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) [6491c42a] Attempting to update VMs/Templates Ovf. >2014-09-26 17:28:11,411 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-26 18:28:11,413 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-26 19:28:11,416 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-26 20:28:11,417 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-26 21:28:11,419 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-26 22:28:11,421 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-91) Attempting to update VMs/Templates Ovf. >2014-09-26 23:28:11,423 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-09-27 00:28:11,424 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-93) Attempting to update VMs/Templates Ovf. >2014-09-27 01:28:11,426 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-27 02:28:11,429 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-09-27 03:28:11,431 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-94) Attempting to update VMs/Templates Ovf. >2014-09-27 03:35:35,005 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-79) Start deleteAgedOutAuditLogs >2014-09-27 03:35:35,010 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-79) Finished deleteAgedOutAuditLogs >2014-09-27 04:28:11,435 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-27 05:28:11,437 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-27 06:28:11,439 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-09-27 07:28:11,441 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-43) Attempting to update VMs/Templates Ovf. >2014-09-27 08:28:11,442 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-27 09:28:11,445 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-55) Attempting to update VMs/Templates Ovf. >2014-09-27 10:28:11,447 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2014-09-27 11:28:11,449 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-9) Attempting to update VMs/Templates Ovf. >2014-09-27 12:28:11,450 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-19) [6d88040a] Attempting to update VMs/Templates Ovf. >2014-09-27 13:28:11,452 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-27 14:28:11,454 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-80) Attempting to update VMs/Templates Ovf. >2014-09-27 15:28:11,455 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-09-27 16:28:11,457 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-27 17:28:11,459 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-27 18:28:11,461 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-89) Attempting to update VMs/Templates Ovf. >2014-09-27 19:28:11,463 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-45) Attempting to update VMs/Templates Ovf. >2014-09-27 20:28:11,465 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-27 21:28:11,467 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-27 22:28:11,469 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-65) Attempting to update VMs/Templates Ovf. >2014-09-27 23:28:11,471 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) Attempting to update VMs/Templates Ovf. >2014-09-28 00:28:11,473 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-28 01:28:11,475 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-3) [1afc02fd] Attempting to update VMs/Templates Ovf. >2014-09-28 02:28:11,476 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-34) Attempting to update VMs/Templates Ovf. >2014-09-28 03:28:11,478 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-28 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Start deleteAgedOutAuditLogs >2014-09-28 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Finished deleteAgedOutAuditLogs >2014-09-28 04:28:11,479 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) Attempting to update VMs/Templates Ovf. >2014-09-28 05:28:11,480 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-72) Attempting to update VMs/Templates Ovf. >2014-09-28 06:28:11,482 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-28 07:28:11,483 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2014-09-28 08:28:11,485 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-09-28 09:28:11,487 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-28 10:28:11,489 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-09-28 11:28:11,491 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-28 12:28:11,493 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-28 13:28:11,495 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-28 14:28:11,496 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-68) Attempting to update VMs/Templates Ovf. >2014-09-28 15:28:11,498 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-1) Attempting to update VMs/Templates Ovf. >2014-09-28 16:28:11,499 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-33) Attempting to update VMs/Templates Ovf. >2014-09-28 17:28:11,501 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-11) Attempting to update VMs/Templates Ovf. >2014-09-28 18:28:11,502 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-28 19:28:11,503 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-2) Attempting to update VMs/Templates Ovf. >2014-09-28 20:28:11,505 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-88) Attempting to update VMs/Templates Ovf. >2014-09-28 21:28:11,506 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-25) Attempting to update VMs/Templates Ovf. >2014-09-28 22:28:11,507 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-38) [9b9dd8b] Attempting to update VMs/Templates Ovf. >2014-09-28 23:28:11,509 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-29 00:28:11,511 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-09-29 01:28:11,513 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-71) Attempting to update VMs/Templates Ovf. >2014-09-29 02:28:11,514 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-09-29 03:28:11,516 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-98) Attempting to update VMs/Templates Ovf. >2014-09-29 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Start deleteAgedOutAuditLogs >2014-09-29 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Finished deleteAgedOutAuditLogs >2014-09-29 04:28:11,518 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-47) Attempting to update VMs/Templates Ovf. >2014-09-29 05:28:11,520 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-14) Attempting to update VMs/Templates Ovf. >2014-09-29 06:28:11,522 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) [6491c42a] Attempting to update VMs/Templates Ovf. >2014-09-29 07:28:11,525 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-35) Attempting to update VMs/Templates Ovf. >2014-09-29 08:28:11,527 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-69) [6aeb192] Attempting to update VMs/Templates Ovf. >2014-09-29 09:28:11,529 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-92) Attempting to update VMs/Templates Ovf. >2014-09-29 10:28:11,530 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-29 11:28:11,532 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-29 12:28:11,531 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-29 13:28:11,533 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-09-29 14:28:11,535 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-61) [3aafce22] Attempting to update VMs/Templates Ovf. >2014-09-29 15:28:11,537 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-29 16:28:11,539 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2014-09-29 17:28:11,540 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-29 18:28:11,542 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-09-29 19:28:11,544 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-59) Attempting to update VMs/Templates Ovf. >2014-09-29 20:28:11,546 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-73) Attempting to update VMs/Templates Ovf. >2014-09-29 21:28:11,548 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-58) Attempting to update VMs/Templates Ovf. >2014-09-29 22:28:11,549 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-60) Attempting to update VMs/Templates Ovf. >2014-09-29 23:28:11,552 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2014-09-30 00:28:11,553 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-40) Attempting to update VMs/Templates Ovf. >2014-09-30 01:28:11,555 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-27) Attempting to update VMs/Templates Ovf. >2014-09-30 02:28:11,558 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-09-30 03:28:11,560 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-41) Attempting to update VMs/Templates Ovf. >2014-09-30 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-90) Start deleteAgedOutAuditLogs >2014-09-30 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-90) Finished deleteAgedOutAuditLogs >2014-09-30 04:28:11,561 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-64) [62335d4b] Attempting to update VMs/Templates Ovf. >2014-09-30 05:28:11,563 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2014-09-30 06:28:11,565 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2014-09-30 07:28:11,569 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-09-30 08:28:11,571 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-52) Attempting to update VMs/Templates Ovf. >2014-09-30 09:28:11,573 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-32) Attempting to update VMs/Templates Ovf. >2014-09-30 10:28:11,575 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-54) Attempting to update VMs/Templates Ovf. >2014-09-30 11:28:11,577 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-4) Attempting to update VMs/Templates Ovf. >2014-09-30 12:28:11,580 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-09-30 13:28:11,582 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-30) Attempting to update VMs/Templates Ovf. >2014-09-30 14:28:11,583 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-85) Attempting to update VMs/Templates Ovf. >2014-09-30 15:28:11,586 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-70) Attempting to update VMs/Templates Ovf. >2014-09-30 16:28:11,588 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-100) Attempting to update VMs/Templates Ovf. >2014-09-30 17:28:11,590 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-09-30 18:28:11,593 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-09-30 19:28:11,595 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-79) Attempting to update VMs/Templates Ovf. >2014-09-30 20:28:11,596 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-7) [6491c42a] Attempting to update VMs/Templates Ovf. >2014-09-30 21:28:11,599 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-67) Attempting to update VMs/Templates Ovf. >2014-09-30 22:28:11,600 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2014-09-30 23:28:11,601 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) Attempting to update VMs/Templates Ovf. >2014-10-01 00:28:11,603 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-6) [33270fe6] Attempting to update VMs/Templates Ovf. >2014-10-01 01:28:11,605 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-10-01 02:28:11,607 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-5) Attempting to update VMs/Templates Ovf. >2014-10-01 03:28:11,608 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-8) [35234e2f] Attempting to update VMs/Templates Ovf. >2014-10-01 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Start deleteAgedOutAuditLogs >2014-10-01 03:35:35,003 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-72) Finished deleteAgedOutAuditLogs >2014-10-01 04:28:11,609 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-87) Attempting to update VMs/Templates Ovf. >2014-10-01 05:28:11,610 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-10-01 06:28:11,612 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-24) Attempting to update VMs/Templates Ovf. >2014-10-01 07:28:11,615 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-56) Attempting to update VMs/Templates Ovf. >2014-10-01 08:28:11,617 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-63) Attempting to update VMs/Templates Ovf. >2014-10-01 09:28:11,619 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-37) Attempting to update VMs/Templates Ovf. >2014-10-01 10:28:11,620 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-44) Attempting to update VMs/Templates Ovf. >2014-10-01 11:28:11,621 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-36) Attempting to update VMs/Templates Ovf. >2014-10-01 12:28:11,623 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-13) Attempting to update VMs/Templates Ovf. >2014-10-01 13:28:11,625 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-23) Attempting to update VMs/Templates Ovf. >2014-10-01 14:28:11,627 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-18) Attempting to update VMs/Templates Ovf. >2014-10-01 15:28:11,629 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-29) Attempting to update VMs/Templates Ovf. >2014-10-01 15:33:47,414 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginAdminUserCommand internal: false. >2014-10-01 15:33:47,420 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-01 15:33:47,491 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginUserCommand internal: false. >2014-10-01 15:33:47,491 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-5) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-10-01 15:33:47,807 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-9) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-10-01 15:35:17,256 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginAdminUserCommand internal: false. >2014-10-01 15:35:17,260 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin logged in. >2014-10-01 15:35:17,373 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginUserCommand internal: false. >2014-10-01 15:35:17,373 ERROR [org.ovirt.engine.api.common.security.auth.Challenger] (ajp-/127.0.0.1:8702-11) Session-TTL header cannot be zero or negative, endless session is not supported. >2014-10-01 15:35:17,665 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-4) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-10-01 15:36:41,886 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-9) [3384d6d0] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-10-01 15:36:41,900 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [373884a1] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:36:41,905 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [373884a1] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 15:36:41,907 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] START, RemoveVdsVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 57937a9b >2014-10-01 15:36:41,907 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] FINISH, RemoveVdsVDSCommand, log id: 57937a9b >2014-10-01 15:36:41,909 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] START, AddVdsVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 3db313da >2014-10-01 15:36:41,909 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] AddVds - entered , starting logic to add VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a >2014-10-01 15:36:41,910 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] AddVds - VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a was added, will try to add it to the resource manager >2014-10-01 15:36:41,911 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [373884a1] Entered VdsManager constructor >2014-10-01 15:36:41,923 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [373884a1] Initialize vdsBroker (10.34.62.205,54,321) >2014-10-01 15:36:41,923 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [373884a1] VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a was added to the Resource Manager >2014-10-01 15:36:41,923 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [373884a1] FINISH, AddVdsVDSCommand, log id: 3db313da >2014-10-01 15:36:41,929 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [373884a1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:36:41,940 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [373884a1] Correlation ID: 3384d6d0, Job ID: fe753904-dbb7-435c-9f88-3085d81696ab, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was added by admin. >2014-10-01 15:36:41,958 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] Lock Acquired to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:36:41,966 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] Running command: InstallVdsCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:36:41,966 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] Before Installation host 6cad778e-9f75-43c2-bdd5-5d25687adc9a, RHEVH >2014-10-01 15:36:41,970 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 46b5673c >2014-10-01 15:36:41,975 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] FINISH, SetVdsStatusVDSCommand, log id: 46b5673c >2014-10-01 15:36:42,090 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-7) [3901937b] Installation 10.34.62.205: Connected to host 10.34.62.205 with SSH key fingerprint: ab:d0:58:83:43:1c:5d:83:72:c9:aa:20:aa:b4:7e:22 >2014-10-01 15:36:42,096 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [3901937b] Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Connected to host 10.34.62.205 with SSH key fingerprint: ab:d0:58:83:43:1c:5d:83:72:c9:aa:20:aa:b4:7e:22. >2014-10-01 15:36:42,114 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-7) [3901937b] Installation of 10.34.62.205. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-01 15:36:42,130 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-7) SSH execute root@10.34.62.205 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-01 15:36:42,659 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Initializing >2014-10-01 15:36:42,667 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Initializing. >2014-10-01 15:36:42,678 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment setup >2014-10-01 15:36:42,684 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Environment setup. >2014-10-01 15:36:42,684 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment packages setup >2014-10-01 15:36:42,691 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Environment packages setup. >2014-10-01 15:36:42,691 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Programs detection >2014-10-01 15:36:42,698 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Programs detection. >2014-10-01 15:36:42,698 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Environment customization >2014-10-01 15:36:42,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Environment customization. >2014-10-01 15:36:42,713 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Host is hypervisor >2014-10-01 15:36:42,719 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Host is hypervisor. >2014-10-01 15:36:42,727 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Logs at host located at: '/tmp/ovirt-host-deploy-20141001133642-khiedw.log' >2014-10-01 15:36:42,733 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Logs at host located at: '/tmp/ovirt-host-deploy-20141001133642-khiedw.log'. >2014-10-01 15:36:42,791 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.62.205 reports unique id 4C4C4544-0034-5310-8052-B3C04F4A354A >2014-10-01 15:36:42,816 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0034-5310-8052-B3C04F4A354A to Host 10.34.62.205 >2014-10-01 15:36:42,877 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Setup validation >2014-10-01 15:36:42,883 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Setup validation. >2014-10-01 15:36:42,925 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Hardware supports virtualization >2014-10-01 15:36:42,932 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Hardware supports virtualization. >2014-10-01 15:36:42,932 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction setup >2014-10-01 15:36:42,937 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Transaction setup. >2014-10-01 15:36:42,937 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-01 15:36:42,942 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Misc configuration. >2014-10-01 15:36:42,942 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Package installation >2014-10-01 15:36:42,947 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Package installation. >2014-10-01 15:36:44,925 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-90) Initializing Host: RHEVH >2014-10-01 15:36:50,476 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Misc configuration >2014-10-01 15:36:50,483 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Misc configuration. >2014-10-01 15:36:50,736 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Enrolling certificate >2014-10-01 15:36:50,742 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Enrolling certificate. >2014-10-01 15:36:51,928 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Transaction commit >2014-10-01 15:36:51,935 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Transaction commit. >2014-10-01 15:36:51,935 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stage: Closing up >2014-10-01 15:36:51,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stage: Closing up. >2014-10-01 15:36:54,809 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Stopping libvirtd >2014-10-01 15:36:54,816 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Stopping libvirtd. >2014-10-01 15:36:55,126 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Starting vdsm >2014-10-01 15:36:55,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Starting vdsm. >2014-10-01 15:37:04,553 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.62.205: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001153704-10.34.62.205-3901937b.log' >2014-10-01 15:37:04,559 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 3901937b, Call Stack: null, Custom Event ID: -1, Message: Installing Host RHEVH. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001153704-10.34.62.205-3901937b.log'. >2014-10-01 15:37:04,778 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 15:37:04,779 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] Command PollVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 15:37:05,291 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-7) [3901937b] Engine managed to communicate with VDSM agent on host RHEVH >2014-10-01 15:37:05,413 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 600d52dc >2014-10-01 15:37:05,417 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] FINISH, SetVdsStatusVDSCommand, log id: 600d52dc >2014-10-01 15:37:05,417 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] After Installation host RHEVH, oVirtNode >2014-10-01 15:37:05,423 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-7) [3901937b] Correlation ID: 3901937b, Job ID: fe753904-dbb7-435c-9f88-3085d81696ab, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH installed >2014-10-01 15:37:05,428 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-7) [3901937b] Lock freed to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:37:05,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 361f93c3 >2014-10-01 15:37:06,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetHardwareInfoVDSCommand, log id: 361f93c3 >2014-10-01 15:37:06,097 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-68) [3fd91330] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:37:06,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [3fd91330] START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 63baa285 >2014-10-01 15:37:06,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-68) [3fd91330] FINISH, GetHardwareInfoVDSCommand, log id: 63baa285 >2014-10-01 15:37:06,205 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [3fd91330] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host RHEVH. >2014-10-01 15:37:06,250 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-68) [129221b6] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:37:06,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-68) [129221b6] START, SetMOMPolicyParametersVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 3659b72e >2014-10-01 15:37:06,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-68) [129221b6] FINISH, SetMOMPolicyParametersVDSCommand, log id: 3659b72e >2014-10-01 15:37:06,356 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [129221b6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:37:06,363 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-68) [623350ff] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:37:06,367 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-68) [1ed8e30d] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:38:12,613 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [1649f432] Lock Acquired to object EngineLock [exclusiveLocks= key: 1afc2e24-b430-4b07-868d-4c9c233b18c3 value: VM >, sharedLocks= ] >2014-10-01 15:38:12,635 WARN [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [1649f432] CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,ACTION_TYPE_FAILED_IMAGE_REPOSITORY_NOT_FOUND >2014-10-01 15:38:12,635 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [1649f432] Lock freed to object EngineLock [exclusiveLocks= key: 1afc2e24-b430-4b07-868d-4c9c233b18c3 value: VM >, sharedLocks= ] >2014-10-01 15:40:17,036 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (ajp-/127.0.0.1:8702-8) [266fda1c] Lock Acquired to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >, sharedLocks= ] >2014-10-01 15:40:17,129 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (org.ovirt.thread.pool-4-thread-5) [266fda1c] Running command: AddStoragePoolWithStoragesCommand internal: false. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:40:17,270 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:40:17,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] START, ConnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 70c3ad74 >2014-10-01 15:40:17,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 70c3ad74 >2014-10-01 15:40:17,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] START, CreateStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId=e25cb031-2c3f-4070-a0e9-55237c7921ef, storagePoolName=datacenter_None, masterDomainId=14d75c12-42cd-4215-b4a8-e2a46ee83005, domainsIdList=[14d75c12-42cd-4215-b4a8-e2a46ee83005], masterVersion=1), log id: 72eb8a05 >2014-10-01 15:40:41,588 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] FINISH, CreateStoragePoolVDSCommand, log id: 72eb8a05 >2014-10-01 15:40:41,591 INFO [org.ovirt.engine.core.bll.storage.AddStoragePoolWithStoragesCommand] (org.ovirt.thread.pool-4-thread-5) [12281f6f] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >, sharedLocks= ] >2014-10-01 15:40:41,592 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [495c7013] Lock Acquired to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >, sharedLocks= ] >2014-10-01 15:40:41,598 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [495c7013] Running command: ActivateStorageDomainCommand internal: true. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-10-01 15:40:41,603 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [495c7013] Lock freed to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >, sharedLocks= ] >2014-10-01 15:40:41,603 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [495c7013] ActivateStorage Domain. Before Connect all hosts to pool. Time:10/1/14 3:40 PM >2014-10-01 15:40:41,604 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-13) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:40:41,606 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-13) [3a433949] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:40:41,607 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (org.ovirt.thread.pool-4-thread-41) [cada0a1] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:40:41,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3a433949] START, ConnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7d8b6048 >2014-10-01 15:40:41,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [cada0a1] START, ConnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4229ac0a >2014-10-01 15:40:41,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-13) [3a433949] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 7d8b6048 >2014-10-01 15:40:41,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-41) [cada0a1] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 4229ac0a >2014-10-01 15:40:41,825 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-5) [495c7013] START, ActivateStorageDomainVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005), log id: 21dffc99 >2014-10-01 15:40:41,831 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:40:41,843 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Correlation ID: 40ff02fa, Call Stack: null, Custom Event ID: -1, Message: Data Center is being initialized, please wait for initialization to complete. >2014-10-01 15:40:41,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] hostFromVds::selectedVds - RHEVH, spmStatus Unknown_Pool, storage pool datacenter_None >2014-10-01 15:40:41,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] START, ConnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: 68a745b >2014-10-01 15:40:42,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] FINISH, ConnectStoragePoolVDSCommand, log id: 68a745b >2014-10-01 15:40:42,640 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] hostFromVds::Connected host to pool - selectedVds - RHEVH, spmStatus Free, storage pool datacenter_None >2014-10-01 15:40:42,646 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] starting spm on vds RHEVH, storage pool datacenter_None, prevId -1, LVER -1 >2014-10-01 15:40:42,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] START, SpmStartVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 49f462b >2014-10-01 15:40:42,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] spmStart polling started: taskId = 30fcc694-c69f-4dda-9fba-5a07c94746f5 >2014-10-01 15:41:04,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] spmStart polling ended: taskId = 30fcc694-c69f-4dda-9fba-5a07c94746f5 task status = finished >2014-10-01 15:41:04,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] spmStart polling ended, spm status: SPM >2014-10-01 15:41:04,887 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] START, HSMClearTaskVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, taskId=30fcc694-c69f-4dda-9fba-5a07c94746f5), log id: 3d4bec7d >2014-10-01 15:41:04,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] FINISH, HSMClearTaskVDSCommand, log id: 3d4bec7d >2014-10-01 15:41:04,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7f30970d, log id: 49f462b >2014-10-01 15:41:04,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Initialize Irs proxy from vds: 10.34.62.205 >2014-10-01 15:41:04,943 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host RHEVH (Address: 10.34.62.205). >2014-10-01 15:41:04,955 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-50) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:41:05,016 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] FINISH, ActivateStorageDomainVDSCommand, log id: 21dffc99 >2014-10-01 15:41:05,016 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] ActivateStorage Domain. After Connect all hosts to pool. Time:10/1/14 3:41 PM >2014-10-01 15:41:05,019 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:41:05,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-8) [40ff02fa] START, ConnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: b20531d >2014-10-01 15:41:05,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-17) [40ff02fa] START, ConnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: 31ce612f >2014-10-01 15:41:05,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-8) [40ff02fa] FINISH, ConnectStoragePoolVDSCommand, log id: b20531d >2014-10-01 15:41:05,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-17) [40ff02fa] FINISH, ConnectStoragePoolVDSCommand, log id: 31ce612f >2014-10-01 15:41:05,557 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] ActivateStorage Domain. After change storage pool status in vds. Time:10/1/14 3:41 PM >2014-10-01 15:41:05,562 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Correlation ID: 495c7013, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test (Data Center datacenter_None) was activated by admin >2014-10-01 15:41:05,572 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) [40ff02fa] Correlation ID: 266fda1c, Job ID: 27d175ec-80dc-4668-9cf8-5479cdcbbebe, Call Stack: null, Custom Event ID: -1, Message: Storage Domains were attached to Data Center datacenter_None by admin >2014-10-01 15:42:29,138 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [690f3834] Lock Acquired to object EngineLock [exclusiveLocks= key: new_vm value: VM_NAME >, sharedLocks= ] >2014-10-01 15:42:29,180 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [690f3834] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups, ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-10-01 15:42:29,256 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [690f3834] Correlation ID: 690f3834, Job ID: c6188336-e92e-4348-a556-c34b582bad99, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was created by admin. >2014-10-01 15:42:29,261 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-3) [690f3834] Lock freed to object EngineLock [exclusiveLocks= key: new_vm value: VM_NAME >, sharedLocks= ] >2014-10-01 15:42:30,570 INFO [org.ovirt.engine.core.bll.network.vm.UpdateVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [3cac75b5] Running command: UpdateVmInterfaceCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM, ID: 786a342f-142c-4179-8d12-2f3ac938cbd8 Type: VnicProfile >2014-10-01 15:42:30,618 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [3cac75b5] Correlation ID: 3cac75b5, Call Stack: null, Custom Event ID: -1, Message: Interface nic1 (VirtIO) was updated for VM new_vm. (User: admin) >2014-10-01 15:42:30,655 INFO [org.ovirt.engine.core.bll.network.vm.ReorderVmNicsCommand] (ajp-/127.0.0.1:8702-9) [608a36df] Running command: ReorderVmNicsCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:42:35,789 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-9) [1f4ad1f9] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:42:35,816 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [1f4ad1f9] START, IsVmDuringInitiatingVDSCommand( vmId = c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: d93b11e >2014-10-01 15:42:35,816 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-9) [1f4ad1f9] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: d93b11e >2014-10-01 15:42:35,856 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] Running command: RunVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:42:35,898 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] START, CreateVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 7d2bee07 >2014-10-01 15:42:35,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] START, CreateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 869efe4 >2014-10-01 15:42:35,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=512,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe,devices=[{specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=c1d43df6-0467-44b0-ab13-a88d2d028cf4}, {shared=false, iface=ide, index=2, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=fed715ca-294d-4675-99d4-c0fb55ed592f}, {nicModel=pv, bootOrder=1, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0b, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=3132aec1-b5f4-4f91-8174-e3bdc3d0e56e}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=6b2d1bcf-6e78-49cd-9478-d6e16d9e6db1}, {index=0, model=virtio-scsi, specParams={}, device=scsi, type=controller, deviceId=6df480b2-7a40-4df4-92b2-18d473377545}],acpiEnable=true,vmName=new_vm,cpuType=Nehalem,custom={} >2014-10-01 15:42:35,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] FINISH, CreateVDSCommand, log id: 869efe4 >2014-10-01 15:42:35,992 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 7d2bee07 >2014-10-01 15:42:35,992 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:42:35,996 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-2) [1f4ad1f9] Correlation ID: 1f4ad1f9, Job ID: 22c5444c-4717-4b7a-8229-9b44f1bf8268, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was started by admin (Host: RHEVH). >2014-10-01 15:42:39,364 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from WaitForLaunch --> PoweringUp >2014-10-01 15:42:39,365 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-87) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 7393da50 >2014-10-01 15:42:39,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-87) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=30636, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@6fe1f577, vmName=new_vm, cpuType=Nehalem}], log id: 7393da50 >2014-10-01 15:42:41,528 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-6) [6eafb49] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:42:41,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [6eafb49] START, SetVmTicketVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, ticket=nnLuNGMhnCwD, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 3affd3fd >2014-10-01 15:42:41,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [6eafb49] FINISH, SetVmTicketVDSCommand, log id: 3affd3fd >2014-10-01 15:42:41,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [6eafb49] Correlation ID: 6eafb49, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM new_vm >2014-10-01 15:42:48,512 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-19) [6d88040a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM new_vm. >2014-10-01 15:43:07,207 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-3) [312b2671] Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >] >2014-10-01 15:43:07,251 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:43:07,254 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 575da068 >2014-10-01 15:43:07,254 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] VDS RHEVH is spm and moved from up calling resetIrs. >2014-10-01 15:43:07,254 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] START, ResetIrsVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, vdsId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, ignoreStopFailed = false), log id: 5a7b3071 >2014-10-01 15:43:07,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] START, SpmStopVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef), log id: 21e00b49 >2014-10-01 15:43:07,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] SpmStopVDSCommand::Stopping SPM on vds RHEVH, pool id e25cb031-2c3f-4070-a0e9-55237c7921ef >2014-10-01 15:43:07,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] FINISH, SpmStopVDSCommand, log id: 21e00b49 >2014-10-01 15:43:07,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] FINISH, ResetIrsVDSCommand, log id: 5a7b3071 >2014-10-01 15:43:07,420 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] FINISH, SetVdsStatusVDSCommand, log id: 575da068 >2014-10-01 15:43:07,423 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >] >2014-10-01 15:43:07,445 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-12) [312b2671] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:43:07,475 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:43:07,550 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:43:07,624 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 2a67e31a >2014-10-01 15:43:07,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] VdsBroker::migrate::Entered (vm_guid=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:43:07,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 12044220 >2014-10-01 15:43:07,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] FINISH, MigrateBrokerVDSCommand, log id: 12044220 >2014-10-01 15:43:07,643 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-12) [65fa814c] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 2a67e31a >2014-10-01 15:43:07,653 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [65fa814c] Correlation ID: 312b2671, Job ID: 67577294-a639-43ce-88cc-2d2a42f9e909, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was switched to Maintenance mode by admin. >2014-10-01 15:43:09,740 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-89) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from MigratingFrom --> PoweringUp >2014-10-01 15:43:09,740 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-89) Adding VM c1aeab18-1691-4b8c-9447-33e954c8b5fe to re-run list >2014-10-01 15:43:09,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-89) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 1b0b966 >2014-10-01 15:43:09,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-89) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=30636, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@795bd867, vmName=new_vm, cpuType=Nehalem}], log id: 1b0b966 >2014-10-01 15:43:09,786 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-89) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds RHEVH >2014-10-01 15:43:09,814 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-37) Correlation ID: 65fa814c, Job ID: 67577294-a639-43ce-88cc-2d2a42f9e909, Call Stack: null, Custom Event ID: -1, Message: Migration failed while Host is in 'preparing for maintenance' state. > Consider manual intervention: stopping/migrating Vms as Host's state will not > turn to maintenance while VMs are still running on it.(VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:43:09,815 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-37) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:43:09,815 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-37) [dbacc6b] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:43:15,832 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:43:15,833 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Storage Pool e25cb031-2c3f-4070-a0e9-55237c7921ef - Updating Storage Domain 14d75c12-42cd-4215-b4a8-e2a46ee83005 status from Active to Unknown, reason : null >2014-10-01 15:43:15,839 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Correlation ID: 2b83aa32, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center datacenter_None. Setting status to Non Responsive. >2014-10-01 15:43:15,854 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] hostFromVds::selectedVds - rack, spmStatus Free, storage pool datacenter_None >2014-10-01 15:43:15,856 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] SPM Init: could not find reported vds or not up - pool:datacenter_None vds_spm_id: 2 >2014-10-01 15:43:15,858 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] SPM selection - vds seems as spm RHEVH >2014-10-01 15:43:15,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] START, SpmStopVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef), log id: 565886bb >2014-10-01 15:43:15,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM]] > >2014-10-01 15:43:15,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] HostName = RHEVH >2014-10-01 15:43:15,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Command HSMGetAllTasksStatusesVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a) execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM >2014-10-01 15:43:15,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] FINISH, SpmStopVDSCommand, log id: 565886bb >2014-10-01 15:43:15,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] spm stop succeeded, continuing with spm selection >2014-10-01 15:43:15,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] starting spm on vds rack, storage pool datacenter_None, prevId 2, LVER 0 >2014-10-01 15:43:15,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] START, SpmStartVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, prevId=2, prevLVER=0, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=true), log id: f52aabc >2014-10-01 15:43:15,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] spmStart polling started: taskId = 953c1485-039c-4d06-b0f0-40c8585e4305 >2014-10-01 15:43:16,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] spmStart polling ended: taskId = 953c1485-039c-4d06-b0f0-40c8585e4305 task status = finished >2014-10-01 15:43:16,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] spmStart polling ended, spm status: SPM >2014-10-01 15:43:16,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] START, HSMClearTaskVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, taskId=953c1485-039c-4d06-b0f0-40c8585e4305), log id: 45eba363 >2014-10-01 15:43:17,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] FINISH, HSMClearTaskVDSCommand, log id: 45eba363 >2014-10-01 15:43:17,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@17621e21, log id: f52aabc >2014-10-01 15:43:17,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Initialize Irs proxy from vds: dell-r210ii-16.rhev.lab.eng.brq.redhat.com >2014-10-01 15:43:17,027 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host rack (Address: dell-r210ii-16.rhev.lab.eng.brq.redhat.com). >2014-10-01 15:43:17,028 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-41) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:43:17,099 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false), log id: 7e177b5a >2014-10-01 15:43:17,166 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] -- executeIrsBrokerCommand: Attempting on storage pool e25cb031-2c3f-4070-a0e9-55237c7921ef >2014-10-01 15:43:17,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] START, HSMGetAllTasksInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 53df7c77 >2014-10-01 15:43:17,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 53df7c77 >2014-10-01 15:43:17,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 7e177b5a >2014-10-01 15:43:17,174 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-41) [2b83aa32] Discovered no tasks on Storage Pool datacenter_None >2014-10-01 15:43:37,510 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-79) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from PoweringUp --> Up >2014-10-01 15:44:21,759 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-1) [6b434963] Lock Acquired to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:44:21,780 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:44:21,780 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] Before acquiring lock in order to prevent monitoring for host RHEVH from data-center datacenter_None >2014-10-01 15:44:21,780 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] Lock acquired, from now a monitoring of host will be skipped for host RHEVH from data-center datacenter_None >2014-10-01 15:44:21,789 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 525e3c57 >2014-10-01 15:44:21,801 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] FINISH, SetVdsStatusVDSCommand, log id: 525e3c57 >2014-10-01 15:44:21,828 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] Activate finished. Lock released. Monitoring can run now for host RHEVH from data-center datacenter_None >2014-10-01 15:44:21,832 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-24) [6b434963] Correlation ID: 6b434963, Job ID: 90b114b5-f52b-48bd-a23c-9f6fede95c95, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was activated by admin. >2014-10-01 15:44:21,838 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-24) [6b434963] Lock freed to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:44:23,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 6eade8e2 >2014-10-01 15:44:23,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GetHardwareInfoVDSCommand, log id: 6eade8e2 >2014-10-01 15:44:23,697 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-31) [39076709] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:44:23,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [39076709] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host RHEVH. >2014-10-01 15:44:23,711 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-31) [1e1ed33c] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:44:23,716 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:44:23,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] START, ConnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4456352 >2014-10-01 15:44:23,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 4456352 >2014-10-01 15:44:23,783 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] Host RHEVH storage connection was succeeded >2014-10-01 15:44:23,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-25) START, ConnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: 4344a620 >2014-10-01 15:44:24,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-25) FINISH, ConnectStoragePoolVDSCommand, log id: 4344a620 >2014-10-01 15:44:24,157 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] START, SetMOMPolicyParametersVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 25d94f78 >2014-10-01 15:44:24,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] FINISH, SetMOMPolicyParametersVDSCommand, log id: 25d94f78 >2014-10-01 15:44:24,345 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [5d29b9ef] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:44:24,354 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-31) [25b2c2b5] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:44:36,471 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) [33270fe6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal got disconnected from VM new_vm. >2014-10-01 15:44:41,024 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] Running command: StopVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:44:41,028 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] START, DestroyVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 3981357e >2014-10-01 15:44:41,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 5d2ade1c >2014-10-01 15:44:41,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] FINISH, DestroyVDSCommand, log id: 5d2ade1c >2014-10-01 15:44:41,597 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] FINISH, DestroyVmVDSCommand, return: Down, log id: 3981357e >2014-10-01 15:44:41,599 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-24) [1982f09a] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:44:41,608 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [5bc3beed] Correlation ID: 5bc3beed, Job ID: 0abb6e20-0965-4863-abfe-0154bdf871cf, Call Stack: null, Custom Event ID: -1, Message: VM new_vm powered off by admin (Host: RHEVH). >2014-10-01 15:44:50,784 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [7b7c3c6c] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM_DISK_BOOT >, sharedLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >] >2014-10-01 15:44:50,842 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-3) [7b7c3c6c] Running command: AddDiskCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM, ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-10-01 15:44:50,890 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [3c11bf61] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-10-01 15:44:50,903 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-3) [3c11bf61] Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM_DISK_BOOT >, sharedLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >] >2014-10-01 15:44:50,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [3c11bf61] START, CreateImageVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, imageGroupId = b7665fda-69fd-401d-8431-3c9c62e4493b, imageSizeInBytes = 5368709120, volumeFormat = RAW, newImageId = 1192c5db-4501-4822-b71e-4907015f9bb8, newImageDescription = ), log id: 12a73ceb >2014-10-01 15:44:50,904 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [3c11bf61] -- executeIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2014-10-01 15:44:51,354 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-3) [3c11bf61] FINISH, CreateImageVDSCommand, return: 1192c5db-4501-4822-b71e-4907015f9bb8, log id: 12a73ceb >2014-10-01 15:44:51,367 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp-/127.0.0.1:8702-3) [3c11bf61] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command dc0599d5-e626-49b5-87ec-1d0af2ecaa22 >2014-10-01 15:44:51,367 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp-/127.0.0.1:8702-3) [3c11bf61] CommandMultiAsyncTasks::AttachTask: Attaching task 0b4780e7-d6aa-4948-9b94-164c2e39947e to command dc0599d5-e626-49b5-87ec-1d0af2ecaa22. >2014-10-01 15:44:51,377 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-3) [3c11bf61] Adding task 0b4780e7-d6aa-4948-9b94-164c2e39947e (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2014-10-01 15:44:51,394 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [3c11bf61] Correlation ID: 7b7c3c6c, Job ID: d9b2659f-86f8-40d9-80e7-17dbce3b5749, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of new_vm_Disk1 was initiated on VM new_vm by admin. >2014-10-01 15:44:51,394 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-3) [3c11bf61] BaseAsyncTask::startPollingTask: Starting to poll task 0b4780e7-d6aa-4948-9b94-164c2e39947e. >2014-10-01 15:45:00,078 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-65) Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2014-10-01 15:45:00,084 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) SPMAsyncTask::PollTask: Polling task 0b4780e7-d6aa-4948-9b94-164c2e39947e (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2014-10-01 15:45:00,089 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-65) BaseAsyncTask::OnTaskEndSuccess: Task 0b4780e7-d6aa-4948-9b94-164c2e39947e (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2014-10-01 15:45:00,089 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-65) CommandAsyncTask::EndActionIfNecessary: All tasks of command dc0599d5-e626-49b5-87ec-1d0af2ecaa22 has ended -> executing endAction >2014-10-01 15:45:00,089 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-65) CommandAsyncTask::endAction: Ending action for 1 tasks (command ID: dc0599d5-e626-49b5-87ec-1d0af2ecaa22): calling endAction . >2014-10-01 15:45:00,089 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to endAction AddDisk, executionIndex: 0 >2014-10-01 15:45:00,100 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (org.ovirt.thread.pool-4-thread-39) [7b7c3c6c] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2014-10-01 15:45:00,105 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (org.ovirt.thread.pool-4-thread-39) [3c11bf61] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2014-10-01 15:45:00,116 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c11bf61] START, GetImageInfoVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, imageGroupId = b7665fda-69fd-401d-8431-3c9c62e4493b, imageId = 1192c5db-4501-4822-b71e-4907015f9bb8), log id: 2ed7fe41 >2014-10-01 15:45:00,131 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-4-thread-39) [3c11bf61] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@7126aeb0, log id: 2ed7fe41 >2014-10-01 15:45:00,146 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) Correlation ID: 7b7c3c6c, Job ID: d9b2659f-86f8-40d9-80e7-17dbce3b5749, Call Stack: null, Custom Event ID: -1, Message: The disk new_vm_Disk1 was successfully added to VM new_vm. >2014-10-01 15:45:00,146 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk completed, handling the result. >2014-10-01 15:45:00,146 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type AddDisk succeeded, clearing tasks. >2014-10-01 15:45:00,150 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-39) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0b4780e7-d6aa-4948-9b94-164c2e39947e >2014-10-01 15:45:00,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) START, SPMClearTaskVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, taskId = 0b4780e7-d6aa-4948-9b94-164c2e39947e), log id: 77f8513f >2014-10-01 15:45:00,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) START, HSMClearTaskVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, taskId=0b4780e7-d6aa-4948-9b94-164c2e39947e), log id: 4f9e3ca1 >2014-10-01 15:45:00,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) FINISH, HSMClearTaskVDSCommand, log id: 4f9e3ca1 >2014-10-01 15:45:00,185 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-4-thread-39) FINISH, SPMClearTaskVDSCommand, log id: 77f8513f >2014-10-01 15:45:00,189 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (org.ovirt.thread.pool-4-thread-39) BaseAsyncTask::RemoveTaskFromDB: Removed task 0b4780e7-d6aa-4948-9b94-164c2e39947e from DataBase >2014-10-01 15:45:00,189 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (org.ovirt.thread.pool-4-thread-39) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity dc0599d5-e626-49b5-87ec-1d0af2ecaa22 >2014-10-01 15:45:13,788 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) [4e276125] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:45:13,810 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4e276125] START, IsVmDuringInitiatingVDSCommand( vmId = c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 35dda7fa >2014-10-01 15:45:13,810 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) [4e276125] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 35dda7fa >2014-10-01 15:45:13,846 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] Running command: RunVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:45:13,885 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] START, CreateVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 14c18411 >2014-10-01 15:45:13,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] START, CreateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 598f7e88 >2014-10-01 15:45:13,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=512,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=c1d43df6-0467-44b0-ab13-a88d2d028cf4}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=fed715ca-294d-4675-99d4-c0fb55ed592f}, {shared=false, volumeID=1192c5db-4501-4822-b71e-4907015f9bb8, index=0, iface=virtio, imageID=b7665fda-69fd-401d-8431-3c9c62e4493b, domainID=14d75c12-42cd-4215-b4a8-e2a46ee83005, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=e25cb031-2c3f-4070-a0e9-55237c7921ef, format=raw, type=disk, readonly=false, deviceId=b7665fda-69fd-401d-8431-3c9c62e4493b}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0b, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=3132aec1-b5f4-4f91-8174-e3bdc3d0e56e}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=6b2d1bcf-6e78-49cd-9478-d6e16d9e6db1}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=6df480b2-7a40-4df4-92b2-18d473377545}],acpiEnable=true,vmName=new_vm,cpuType=Nehalem,custom={device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361ba=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3402d2b0-2687-459e-ac33-b530e6d361ba, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbafdevice_a9225fac-c80c-4975-9b29-8292d96548dd=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=a9225fac-c80c-4975-9b29-8292d96548dd, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbaf=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8eba15b3-6e62-4eb6-80cc-dc51c897cbaf, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1a26d79f-5fb0-430a-89fb-31dd3adfe727, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-01 15:45:13,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] FINISH, CreateVDSCommand, log id: 598f7e88 >2014-10-01 15:45:13,971 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 14c18411 >2014-10-01 15:45:13,971 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-42) [4e276125] Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:45:13,976 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-42) [4e276125] Correlation ID: 4e276125, Job ID: eab4f6e8-b1ac-4dbc-a312-2406de94ff87, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was started by admin (Host: RHEVH). >2014-10-01 15:45:15,814 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-28) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from WaitForLaunch --> PoweringUp >2014-10-01 15:45:15,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-28) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 785ca230 >2014-10-01 15:45:15,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-28) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361ba=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3402d2b0-2687-459e-ac33-b530e6d361ba, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbafdevice_a9225fac-c80c-4975-9b29-8292d96548dd=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=a9225fac-c80c-4975-9b29-8292d96548dd, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbaf=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8eba15b3-6e62-4eb6-80cc-dc51c897cbaf, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1a26d79f-5fb0-430a-89fb-31dd3adfe727, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31013, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@99c3b0c, vmName=new_vm, cpuType=Nehalem}], log id: 785ca230 >2014-10-01 15:45:17,489 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [ffd25b4] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:45:17,494 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [ffd25b4] START, SetVmTicketVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, ticket=FHAIFOizY/5N, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1883df51 >2014-10-01 15:45:17,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [ffd25b4] FINISH, SetVmTicketVDSCommand, log id: 1883df51 >2014-10-01 15:45:17,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [ffd25b4] Correlation ID: ffd25b4, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM new_vm >2014-10-01 15:45:21,944 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-35) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM new_vm. >2014-10-01 15:45:43,024 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-17) [54678baf] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:45:43,028 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-17) [54678baf] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 1d9a455d >2014-10-01 15:45:43,034 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-17) [54678baf] FINISH, SetVdsStatusVDSCommand, log id: 1d9a455d >2014-10-01 15:45:43,056 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-17) [54678baf] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:45:43,073 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:45:43,095 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:45:43,118 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 3aacc795 >2014-10-01 15:45:43,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] VdsBroker::migrate::Entered (vm_guid=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:45:43,198 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 7cfdd14c >2014-10-01 15:45:43,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] FINISH, MigrateBrokerVDSCommand, log id: 7cfdd14c >2014-10-01 15:45:43,250 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 3aacc795 >2014-10-01 15:45:43,257 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-17) [6deffaf2] Correlation ID: 54678baf, Job ID: 584b40fb-b2c7-431f-b758-98edf049d812, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was switched to Maintenance mode by admin. >2014-10-01 15:45:46,280 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from MigratingFrom --> PoweringUp >2014-10-01 15:45:46,280 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Adding VM c1aeab18-1691-4b8c-9447-33e954c8b5fe to re-run list >2014-10-01 15:45:46,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 20df7d01 >2014-10-01 15:45:46,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-54) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361ba=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3402d2b0-2687-459e-ac33-b530e6d361ba, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbafdevice_a9225fac-c80c-4975-9b29-8292d96548dd=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=a9225fac-c80c-4975-9b29-8292d96548dd, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbaf=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8eba15b3-6e62-4eb6-80cc-dc51c897cbaf, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1a26d79f-5fb0-430a-89fb-31dd3adfe727, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31013, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@3087dd83, vmName=new_vm, cpuType=Nehalem}], log id: 20df7d01 >2014-10-01 15:45:46,318 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-54) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds RHEVH >2014-10-01 15:45:46,339 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) Correlation ID: 6deffaf2, Job ID: 584b40fb-b2c7-431f-b758-98edf049d812, Call Stack: null, Custom Event ID: -1, Message: Migration failed while Host is in 'preparing for maintenance' state. > Consider manual intervention: stopping/migrating Vms as Host's state will not > turn to maintenance while VMs are still running on it.(VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:45:46,339 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (org.ovirt.thread.pool-4-thread-48) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:45:46,340 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-48) [21787311] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:46:14,001 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) [6aeb192] VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from PoweringUp --> Up >2014-10-01 15:46:14,014 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-13) Setting new tasks map. The map contains now 0 tasks >2014-10-01 15:46:14,015 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-13) Cleared all tasks of pool e25cb031-2c3f-4070-a0e9-55237c7921ef. >2014-10-01 15:47:57,279 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-1) [7455566f] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:47:57,331 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:47:57,349 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 9787b12 >2014-10-01 15:47:57,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] VdsBroker::migrate::Entered (vm_guid=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:47:57,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 4f9b05fc >2014-10-01 15:47:57,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] FINISH, MigrateBrokerVDSCommand, log id: 4f9b05fc >2014-10-01 15:47:57,363 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-45) [7455566f] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 9787b12 >2014-10-01 15:47:57,371 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-45) [7455566f] Correlation ID: 7455566f, Job ID: 4718e85f-3cb6-46b3-b4bc-5722e07728eb, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: new_vm, Source: RHEVH, Destination: rack, User: admin). >2014-10-01 15:47:58,508 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from MigratingFrom --> Up >2014-10-01 15:47:58,509 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Adding VM c1aeab18-1691-4b8c-9447-33e954c8b5fe to re-run list >2014-10-01 15:47:58,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 29b21cdc >2014-10-01 15:47:58,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-81) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473be, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361ba=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3402d2b0-2687-459e-ac33-b530e6d361ba, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbafdevice_a9225fac-c80c-4975-9b29-8292d96548dd=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=a9225fac-c80c-4975-9b29-8292d96548dd, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727device_3402d2b0-2687-459e-ac33-b530e6d361badevice_8eba15b3-6e62-4eb6-80cc-dc51c897cbaf=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8eba15b3-6e62-4eb6-80cc-dc51c897cbaf, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_dcf37d1a-a6d2-4a1d-8ea3-9f2ffa6473bedevice_1a26d79f-5fb0-430a-89fb-31dd3adfe727=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1a26d79f-5fb0-430a-89fb-31dd3adfe727, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31013, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@6c84c4e6, vmName=new_vm, cpuType=Nehalem}], log id: 29b21cdc >2014-10-01 15:47:58,553 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-81) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds RHEVH >2014-10-01 15:47:58,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, MigrateStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 15eb1260 >2014-10-01 15:47:58,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) Failed in MigrateStatusVDS method >2014-10-01 15:47:58,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-01 15:47:58,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) HostName = RHEVH >2014-10-01 15:47:58,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) Command MigrateStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-01 15:47:58,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, MigrateStatusVDSCommand, log id: 15eb1260 >2014-10-01 15:47:58,641 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) Correlation ID: 7455566f, Job ID: 4718e85f-3cb6-46b3-b4bc-5722e07728eb, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration while Host is in 'preparing for maintenance' state. > Consider manual intervention: stopping/migrating Vms as Host's state will not > turn to maintenance while VMs are still running on it.(VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:47:58,645 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-44) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:48:46,430 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-8) [2f235189] Running command: StopVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:48:46,434 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2f235189] START, DestroyVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 5d3a6fca >2014-10-01 15:48:46,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2f235189] START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 4ede91b1 >2014-10-01 15:48:47,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2f235189] FINISH, DestroyVDSCommand, log id: 4ede91b1 >2014-10-01 15:48:47,020 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-8) [2f235189] FINISH, DestroyVmVDSCommand, return: Down, log id: 5d3a6fca >2014-10-01 15:48:47,021 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-34) [5487d484] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:48:47,028 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-8) [2f235189] Correlation ID: 2f235189, Job ID: cf64b0c5-bcaf-4413-bedc-321d794a6562, Call Stack: null, Custom Event ID: -1, Message: VM new_vm powered off by admin (Host: RHEVH). >2014-10-01 15:48:47,764 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-66) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 6cad778e-9f75-43c2-bdd5-5d25687adc9a : RHEVH >2014-10-01 15:48:47,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-5) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: RHEVH. >2014-10-01 15:48:47,778 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-66) START, DisconnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2), log id: 113be679 >2014-10-01 15:48:50,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, DisconnectStoragePoolVDSCommand, log id: 113be679 >2014-10-01 15:48:50,506 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-66) [32d9a8b5] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:48:50,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [32d9a8b5] START, DisconnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6ce9b6c1 >2014-10-01 15:48:50,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-66) [32d9a8b5] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 6ce9b6c1 >2014-10-01 15:48:57,636 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-1) [53748a00] Lock Acquired to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:48:57,666 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:48:57,667 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] Before acquiring lock in order to prevent monitoring for host RHEVH from data-center datacenter_None >2014-10-01 15:48:57,667 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] Lock acquired, from now a monitoring of host will be skipped for host RHEVH from data-center datacenter_None >2014-10-01 15:48:57,696 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1b409f73 >2014-10-01 15:48:57,711 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] FINISH, SetVdsStatusVDSCommand, log id: 1b409f73 >2014-10-01 15:48:57,729 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] Activate finished. Lock released. Monitoring can run now for host RHEVH from data-center datacenter_None >2014-10-01 15:48:57,734 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [53748a00] Correlation ID: 53748a00, Job ID: 0e4edde6-6ae3-45db-9c4e-fcce9c6b1b36, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was activated by admin. >2014-10-01 15:48:57,739 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-9) [53748a00] Lock freed to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:48:59,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 441b310e >2014-10-01 15:48:59,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GetHardwareInfoVDSCommand, log id: 441b310e >2014-10-01 15:48:59,880 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-62) [3d415841] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:48:59,888 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-62) [3d415841] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host RHEVH. >2014-10-01 15:48:59,894 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-62) [47234c59] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:48:59,900 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:48:59,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] START, ConnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1b7b23f1 >2014-10-01 15:49:00,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 1b7b23f1 >2014-10-01 15:49:00,081 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] Host RHEVH storage connection was succeeded >2014-10-01 15:49:00,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-6) START, ConnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: 1f418f03 >2014-10-01 15:49:00,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-6) FINISH, ConnectStoragePoolVDSCommand, log id: 1f418f03 >2014-10-01 15:49:00,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] START, SetMOMPolicyParametersVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 74f9319a >2014-10-01 15:49:00,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-62) [7d51535d] FINISH, SetMOMPolicyParametersVDSCommand, log id: 74f9319a >2014-10-01 15:49:00,831 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-62) [7d51535d] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:49:00,838 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-62) [4a6a3d6c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:49:14,664 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-5) [57fab193] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:49:14,727 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [57fab193] START, IsVmDuringInitiatingVDSCommand( vmId = c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 20663040 >2014-10-01 15:49:14,727 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [57fab193] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 20663040 >2014-10-01 15:49:14,763 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] Running command: RunVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:49:14,932 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] START, CreateVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 577d2582 >2014-10-01 15:49:14,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] START, CreateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: c48c442 >2014-10-01 15:49:14,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=512,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=c1d43df6-0467-44b0-ab13-a88d2d028cf4}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=fed715ca-294d-4675-99d4-c0fb55ed592f}, {shared=false, index=0, volumeID=1192c5db-4501-4822-b71e-4907015f9bb8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=14d75c12-42cd-4215-b4a8-e2a46ee83005, imageID=b7665fda-69fd-401d-8431-3c9c62e4493b, specParams={}, optional=false, device=disk, poolID=e25cb031-2c3f-4070-a0e9-55237c7921ef, readonly=false, deviceId=b7665fda-69fd-401d-8431-3c9c62e4493b}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0b, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=3132aec1-b5f4-4f91-8174-e3bdc3d0e56e}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=6b2d1bcf-6e78-49cd-9478-d6e16d9e6db1}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=6df480b2-7a40-4df4-92b2-18d473377545}],acpiEnable=true,vmName=new_vm,cpuType=Nehalem,custom={device_336db78e-43ef-4026-86f9-d83517ed02d5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=336db78e-43ef-4026-86f9-d83517ed02d5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=37a571d3-68ff-41a7-8798-1f9f16293537, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=d2227089-bebc-4e45-b00c-00768c772ba5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77device_8501c5a7-ca6b-423c-bb1e-8f95625b7935=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8501c5a7-ca6b-423c-bb1e-8f95625b7935, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=168a5b8b-199d-4a1d-bdcf-3c3724b88a77, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-01 15:49:14,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] FINISH, CreateVDSCommand, log id: c48c442 >2014-10-01 15:49:15,008 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 577d2582 >2014-10-01 15:49:15,008 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-33) [57fab193] Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:49:15,013 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-33) [57fab193] Correlation ID: 57fab193, Job ID: cebd2a32-dd8c-4f8b-aa91-a6b7611bf05c, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was started by admin (Host: RHEVH). >2014-10-01 15:49:15,932 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-11) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from WaitForLaunch --> PoweringUp >2014-10-01 15:49:15,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-11) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 11fe293c >2014-10-01 15:49:15,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-11) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_336db78e-43ef-4026-86f9-d83517ed02d5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=336db78e-43ef-4026-86f9-d83517ed02d5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=37a571d3-68ff-41a7-8798-1f9f16293537, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=d2227089-bebc-4e45-b00c-00768c772ba5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77device_8501c5a7-ca6b-423c-bb1e-8f95625b7935=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8501c5a7-ca6b-423c-bb1e-8f95625b7935, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=168a5b8b-199d-4a1d-bdcf-3c3724b88a77, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31453, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@45452b5e, vmName=new_vm, cpuType=Nehalem}], log id: 11fe293c >2014-10-01 15:49:19,994 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [2b45f880] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:49:19,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [2b45f880] START, SetVmTicketVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, ticket=tvVX++4M6iql, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7fec83a3 >2014-10-01 15:49:20,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [2b45f880] FINISH, SetVmTicketVDSCommand, log id: 7fec83a3 >2014-10-01 15:49:20,026 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [2b45f880] Correlation ID: 2b45f880, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM new_vm >2014-10-01 15:49:25,111 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-51) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM new_vm. >2014-10-01 15:49:47,506 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-1) [2283d822] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:49:47,601 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:49:47,620 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 32fe5800 >2014-10-01 15:49:47,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] VdsBroker::migrate::Entered (vm_guid=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:49:47,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 193dd061 >2014-10-01 15:49:47,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] FINISH, MigrateBrokerVDSCommand, log id: 193dd061 >2014-10-01 15:49:47,633 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [2283d822] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 32fe5800 >2014-10-01 15:49:47,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [2283d822] Correlation ID: 2283d822, Job ID: 8c527a82-fa19-4c72-93c7-a7e4d3321eca, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: new_vm, Source: RHEVH, Destination: rack, User: admin). >2014-10-01 15:49:49,069 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-76) RefreshVmList vm id c1aeab18-1691-4b8c-9447-33e954c8b5fe is migrating to vds rack ignoring it in the refresh until migration is done >2014-10-01 15:49:52,105 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [6491c42a] RefreshVmList vm id c1aeab18-1691-4b8c-9447-33e954c8b5fe is migrating to vds rack ignoring it in the refresh until migration is done >2014-10-01 15:49:55,382 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from MigratingFrom --> PoweringUp >2014-10-01 15:49:55,383 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) Adding VM c1aeab18-1691-4b8c-9447-33e954c8b5fe to re-run list >2014-10-01 15:49:55,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 4f971e8d >2014-10-01 15:49:55,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-33) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_336db78e-43ef-4026-86f9-d83517ed02d5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=336db78e-43ef-4026-86f9-d83517ed02d5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=37a571d3-68ff-41a7-8798-1f9f16293537, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=d2227089-bebc-4e45-b00c-00768c772ba5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77device_8501c5a7-ca6b-423c-bb1e-8f95625b7935=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8501c5a7-ca6b-423c-bb1e-8f95625b7935, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=168a5b8b-199d-4a1d-bdcf-3c3724b88a77, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31453, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@4a56e3cd, vmName=new_vm, cpuType=Nehalem}], log id: 4f971e8d >2014-10-01 15:49:55,413 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-33) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds RHEVH >2014-10-01 15:49:55,429 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-39) Correlation ID: 2283d822, Job ID: 8c527a82-fa19-4c72-93c7-a7e4d3321eca, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:49:55,430 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-37) [1ca56c7d] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:49:55,437 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-39) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:50:16,665 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from PoweringUp --> Up >2014-10-01 15:50:34,656 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-9) [4c6213f4] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:50:34,727 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] Running command: MigrateVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:50:34,783 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 229956f1 >2014-10-01 15:50:34,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] VdsBroker::migrate::Entered (vm_guid=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:50:34,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 7f7efb0d >2014-10-01 15:50:34,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] FINISH, MigrateBrokerVDSCommand, log id: 7f7efb0d >2014-10-01 15:50:34,798 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 229956f1 >2014-10-01 15:50:34,805 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-27) [4c6213f4] Correlation ID: 4c6213f4, Job ID: 2e24a6e6-36e6-4ca0-9a09-746710dd26d7, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: new_vm, Source: RHEVH, Destination: rack, User: admin). >2014-10-01 15:50:37,898 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from MigratingFrom --> Up >2014-10-01 15:50:37,899 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Adding VM c1aeab18-1691-4b8c-9447-33e954c8b5fe to re-run list >2014-10-01 15:50:37,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 6c031483 >2014-10-01 15:50:37,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_336db78e-43ef-4026-86f9-d83517ed02d5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=336db78e-43ef-4026-86f9-d83517ed02d5, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=37a571d3-68ff-41a7-8798-1f9f16293537, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=d2227089-bebc-4e45-b00c-00768c772ba5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77device_8501c5a7-ca6b-423c-bb1e-8f95625b7935=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=8501c5a7-ca6b-423c-bb1e-8f95625b7935, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_336db78e-43ef-4026-86f9-d83517ed02d5device_37a571d3-68ff-41a7-8798-1f9f16293537device_d2227089-bebc-4e45-b00c-00768c772ba5device_168a5b8b-199d-4a1d-bdcf-3c3724b88a77=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=168a5b8b-199d-4a1d-bdcf-3c3724b88a77, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31453, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@3e37dbdb, vmName=new_vm, cpuType=Nehalem}], log id: 6c031483 >2014-10-01 15:50:37,931 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds RHEVH >2014-10-01 15:50:37,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) START, MigrateStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 2339a5f7 >2014-10-01 15:50:37,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Failed in MigrateStatusVDS method >2014-10-01 15:50:37,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=12, mMessage=Fatal error during migration]] >2014-10-01 15:50:37,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) HostName = RHEVH >2014-10-01 15:50:37,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) Command MigrateStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe) execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration, code = 12 >2014-10-01 15:50:37,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (org.ovirt.thread.pool-4-thread-21) FINISH, MigrateStatusVDSCommand, log id: 2339a5f7 >2014-10-01 15:50:37,988 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) Correlation ID: 4c6213f4, Job ID: 2e24a6e6-36e6-4ca0-9a09-746710dd26d7, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration. Trying to migrate to another Host (VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:50:38,015 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-21) CanDoAction of action MigrateVm failed. Reasons:VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,VAR__ACTION__MIGRATE,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT >2014-10-01 15:50:38,015 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-21) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:50:38,023 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) Correlation ID: 4c6213f4, Job ID: 2e24a6e6-36e6-4ca0-9a09-746710dd26d7, Call Stack: null, Custom Event ID: -1, Message: Migration failed due to Error: Fatal error during migration (VM: new_vm, Source: RHEVH, Destination: rack). >2014-10-01 15:51:05,115 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] Running command: StopVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:51:05,118 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] START, DestroyVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 6c6dfc5 >2014-10-01 15:51:05,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 18d9f553 >2014-10-01 15:51:05,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] FINISH, DestroyVDSCommand, log id: 18d9f553 >2014-10-01 15:51:05,694 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] FINISH, DestroyVmVDSCommand, return: Down, log id: 6c6dfc5 >2014-10-01 15:51:05,695 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-39) [29150d7f] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:51:05,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [46cb7b92] Correlation ID: 46cb7b92, Job ID: 7d7ac321-6ba6-4277-af51-2aa92ce90265, Call Stack: null, Custom Event ID: -1, Message: VM new_vm powered off by admin (Host: RHEVH). >2014-10-01 15:51:22,105 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-6) [4b983d48] Lock Acquired to object EngineLock [exclusiveLocks= key: new_vm value: VM_NAME >, sharedLocks= ] >2014-10-01 15:51:22,141 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-6) [4b983d48] Running command: UpdateVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM, ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:51:22,166 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [4b983d48] Correlation ID: 4b983d48, Job ID: 83848aad-4681-4369-9a58-f859c3d18741, Call Stack: null, Custom Event ID: -1, Message: VM new_vm configuration was updated by admin. >2014-10-01 15:51:22,169 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-6) [4b983d48] Lock freed to object EngineLock [exclusiveLocks= key: new_vm value: VM_NAME >, sharedLocks= ] >2014-10-01 15:51:25,247 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-4) [c335404] Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:51:25,272 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [c335404] START, IsVmDuringInitiatingVDSCommand( vmId = c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 7198e801 >2014-10-01 15:51:25,273 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [c335404] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 7198e801 >2014-10-01 15:51:25,311 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] Running command: RunVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:51:25,345 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] START, CreateVmVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 5a24ab55 >2014-10-01 15:51:25,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] START, CreateVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 496a75dd >2014-10-01 15:51:25,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=512,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=c1d43df6-0467-44b0-ab13-a88d2d028cf4}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=fed715ca-294d-4675-99d4-c0fb55ed592f}, {shared=false, index=0, volumeID=1192c5db-4501-4822-b71e-4907015f9bb8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=14d75c12-42cd-4215-b4a8-e2a46ee83005, imageID=b7665fda-69fd-401d-8431-3c9c62e4493b, specParams={}, optional=false, device=disk, poolID=e25cb031-2c3f-4070-a0e9-55237c7921ef, readonly=false, deviceId=b7665fda-69fd-401d-8431-3c9c62e4493b}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0b, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=3132aec1-b5f4-4f91-8174-e3bdc3d0e56e}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=6b2d1bcf-6e78-49cd-9478-d6e16d9e6db1}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=6df480b2-7a40-4df4-92b2-18d473377545}],acpiEnable=true,vmName=new_vm,cpuType=Nehalem,custom={device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0cdevice_9641c797-81f7-437f-a1af-fd92157061f3=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=9641c797-81f7-437f-a1af-fd92157061f3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3b46d605-cdc8-4034-a538-0e8bd40e7928, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=45a66000-4f88-4c54-ad74-332e4f99d7b9, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0c=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=5a1fd323-352a-497d-97ba-a37aed996b0c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-01 15:51:25,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] FINISH, CreateVDSCommand, log id: 496a75dd >2014-10-01 15:51:25,413 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5a24ab55 >2014-10-01 15:51:25,413 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-22) [c335404] Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:51:25,419 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [c335404] Correlation ID: c335404, Job ID: 3a811414-c51b-4203-8704-e15b239ccda5, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was started by admin (Host: rack). >2014-10-01 15:51:25,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-17) START, DestroyVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 736c3c57 >2014-10-01 15:51:26,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, DestroyVDSCommand, log id: 736c3c57 >2014-10-01 15:51:26,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-17) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM new_vm is down. Exit message: Child quit during startup handshake: Input/output error. >2014-10-01 15:51:26,039 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Running on vds during rerun failed vm: null >2014-10-01 15:51:26,041 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) VM new_vm (c1aeab18-1691-4b8c-9447-33e954c8b5fe) is running in db and not running in VDS rack >2014-10-01 15:51:26,041 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) START, FullListVdsCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: a6d2c74 >2014-10-01 15:51:26,086 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-17) FINISH, FullListVdsCommand, return: [], log id: a6d2c74 >2014-10-01 15:51:26,093 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-17) Rerun vm c1aeab18-1691-4b8c-9447-33e954c8b5fe. Called from vds rack >2014-10-01 15:51:26,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) Correlation ID: c335404, Job ID: 3a811414-c51b-4203-8704-e15b239ccda5, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM new_vm on Host rack. >2014-10-01 15:51:26,110 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) Lock Acquired to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:51:26,132 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-5) START, IsVmDuringInitiatingVDSCommand( vmId = c1aeab18-1691-4b8c-9447-33e954c8b5fe), log id: 6a391ed4 >2014-10-01 15:51:26,132 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6a391ed4 >2014-10-01 15:51:26,155 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) Running command: RunVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:51:26,188 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) START, CreateVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 64ca063e >2014-10-01 15:51:26,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) START, CreateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, vm=VM [new_vm]), log id: 28c9d0af >2014-10-01 15:51:26,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=512,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=c1d43df6-0467-44b0-ab13-a88d2d028cf4}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=fed715ca-294d-4675-99d4-c0fb55ed592f}, {shared=false, index=0, volumeID=1192c5db-4501-4822-b71e-4907015f9bb8, propagateErrors=off, format=raw, type=disk, iface=virtio, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=14d75c12-42cd-4215-b4a8-e2a46ee83005, imageID=b7665fda-69fd-401d-8431-3c9c62e4493b, specParams={}, optional=false, device=disk, poolID=e25cb031-2c3f-4070-a0e9-55237c7921ef, readonly=false, deviceId=b7665fda-69fd-401d-8431-3c9c62e4493b}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0b, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=3132aec1-b5f4-4f91-8174-e3bdc3d0e56e}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=6b2d1bcf-6e78-49cd-9478-d6e16d9e6db1}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=6df480b2-7a40-4df4-92b2-18d473377545}],acpiEnable=true,vmName=new_vm,cpuType=Nehalem,custom={device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0cdevice_9641c797-81f7-437f-a1af-fd92157061f3=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=9641c797-81f7-437f-a1af-fd92157061f3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3b46d605-cdc8-4034-a538-0e8bd40e7928, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=45a66000-4f88-4c54-ad74-332e4f99d7b9, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0c=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=5a1fd323-352a-497d-97ba-a37aed996b0c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}} >2014-10-01 15:51:26,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-5) FINISH, CreateVDSCommand, log id: 28c9d0af >2014-10-01 15:51:26,251 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-5) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 64ca063e >2014-10-01 15:51:26,251 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-5) Lock freed to object EngineLock [exclusiveLocks= key: c1aeab18-1691-4b8c-9447-33e954c8b5fe value: VM >, sharedLocks= ] >2014-10-01 15:51:26,253 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-5) Correlation ID: c335404, Job ID: 3a811414-c51b-4203-8704-e15b239ccda5, Call Stack: null, Custom Event ID: -1, Message: VM new_vm was started by admin (Host: RHEVH). >2014-10-01 15:51:29,930 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-91) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from WaitForLaunch --> PoweringUp >2014-10-01 15:51:29,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[c1aeab18-1691-4b8c-9447-33e954c8b5fe]), log id: 7a1b461b >2014-10-01 15:51:29,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-91) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, acpiEnable=true, custom={device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0cdevice_9641c797-81f7-437f-a1af-fd92157061f3=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=9641c797-81f7-437f-a1af-fd92157061f3, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=3b46d605-cdc8-4034-a538-0e8bd40e7928, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=45a66000-4f88-4c54-ad74-332e4f99d7b9, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_1155d19b-cf4c-42fa-a2f0-50a4ce1d0fb0device_45a66000-4f88-4c54-ad74-332e4f99d7b9device_3b46d605-cdc8-4034-a538-0e8bd40e7928device_5a1fd323-352a-497d-97ba-a37aed996b0c=VmDevice {vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, deviceId=5a1fd323-352a-497d-97ba-a37aed996b0c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=512, display=qxl, pid=31802, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@1497d53e, vmName=new_vm, cpuType=Nehalem}], log id: 7a1b461b >2014-10-01 15:52:27,472 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-94) VM new_vm c1aeab18-1691-4b8c-9447-33e954c8b5fe moved from PoweringUp --> Up >2014-10-01 15:52:27,482 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-94) Correlation ID: c335404, Job ID: 3a811414-c51b-4203-8704-e15b239ccda5, Call Stack: null, Custom Event ID: -1, Message: Guest new_vm started on Host RHEVH. (Default Host parameter was ignored - assigned Host was not available). >2014-10-01 15:52:27,489 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-35) START, FailedToRunVmVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 238eae6f >2014-10-01 15:52:27,489 INFO [org.ovirt.engine.core.vdsbroker.FailedToRunVmVDSCommand] (org.ovirt.thread.pool-4-thread-35) FINISH, FailedToRunVmVDSCommand, log id: 238eae6f >2014-10-01 15:53:03,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-37) Command ListVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 15:53:03,010 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-37) Failed vds listing, vds = facf6428-64e1-483e-b942-6adf5fb44742 : rack, error = org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 15:53:03,026 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-37) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing > at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:42) > at org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand.executeVdsBrokerCommand(ListVDSCommand.java:24) > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:96) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:410) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.fetchRunningVms(VdsUpdateRunTimeInfo.java:943) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVmStats(VdsUpdateRunTimeInfo.java:899) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:496) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:342) > at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231) > at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >, Custom Event ID: -1, Message: Host rack is initializing. Message: Recovering from crash or Initializing >2014-10-01 15:53:03,026 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-37) Failed to refresh VDS , vds = facf6428-64e1-483e-b942-6adf5fb44742 : rack, error = Recovering from crash or Initializing, continuing. >2014-10-01 15:53:05,579 ERROR [org.ovirt.engine.core.utils.servlet.ServletUtils] (ajp-/127.0.0.1:8702-9) Can't read file "/var/lib/ovirt-engine/reports.xml" for request "/ovirt-engine/services/reports-ui", will send a 404 error response. >2014-10-01 15:53:06,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GetHardwareInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]), log id: 7777beac >2014-10-01 15:53:06,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GetHardwareInfoVDSCommand, log id: 7777beac >2014-10-01 15:53:06,463 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-88) [307bed8a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:53:06,470 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) [307bed8a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host rack. >2014-10-01 15:53:06,515 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-88) [307bed8a] Cancelling the recovery from crash timer for VDS facf6428-64e1-483e-b942-6adf5fb44742 because vds started initializing >2014-10-01 15:53:06,516 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-88) [5472146d] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:53:06,522 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:53:06,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] START, ConnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7916a92e >2014-10-01 15:53:06,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] FINISH, ConnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 7916a92e >2014-10-01 15:53:06,585 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] Host rack storage connection was succeeded >2014-10-01 15:53:06,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, ConnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1, masterDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterVersion = 1), log id: 65d6fa2e >2014-10-01 15:53:07,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, ConnectStoragePoolVDSCommand, log id: 65d6fa2e >2014-10-01 15:53:07,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] START, SetMOMPolicyParametersVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 6692a846 >2014-10-01 15:53:07,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-88) [3e641cc7] FINISH, SetMOMPolicyParametersVDSCommand, log id: 6692a846 >2014-10-01 15:53:07,124 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-88) [3e641cc7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-10-01 15:53:07,133 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-88) [6ad9c1f9] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:53:09,265 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:53:09,267 INFO [org.ovirt.engine.core.vdsbroker.storage.StoragePoolDomainHelper] (DefaultQuartzScheduler_Worker-26) [21a209d3] Storage Pool e25cb031-2c3f-4070-a0e9-55237c7921ef - Updating Storage Domain 14d75c12-42cd-4215-b4a8-e2a46ee83005 status from Active to Unknown, reason : null >2014-10-01 15:53:09,277 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) [21a209d3] Correlation ID: 21a209d3, Call Stack: null, Custom Event ID: -1, Message: Invalid status on Data Center datacenter_None. Setting Data Center status to Non Responsive (On host rack, Error: done). >2014-10-01 15:53:09,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] Command org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand return value > >TaskStatusListReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=654, mMessage=Not SPM]] > >2014-10-01 15:53:09,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] HostName = rack >2014-10-01 15:53:09,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] Command HSMGetAllTasksStatusesVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742) execution failed. Exception: IRSNonOperationalException: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM >2014-10-01 15:53:09,374 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] hostFromVds::selectedVds - rack, spmStatus Free, storage pool datacenter_None >2014-10-01 15:53:09,423 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] SpmStatus on vds facf6428-64e1-483e-b942-6adf5fb44742: Free >2014-10-01 15:53:09,427 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] starting spm on vds rack, storage pool datacenter_None, prevId 1, LVER 1 >2014-10-01 15:53:09,428 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] START, SpmStartVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, prevId=1, prevLVER=1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1ce2ef3d >2014-10-01 15:53:09,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] spmStart polling started: taskId = cfd90e59-4c32-45aa-b3f8-5fd9420cc3a1 >2014-10-01 15:53:10,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] spmStart polling ended: taskId = cfd90e59-4c32-45aa-b3f8-5fd9420cc3a1 task status = finished >2014-10-01 15:53:10,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] spmStart polling ended, spm status: SPM >2014-10-01 15:53:10,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] START, HSMClearTaskVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, taskId=cfd90e59-4c32-45aa-b3f8-5fd9420cc3a1), log id: 4f7da1cf >2014-10-01 15:53:10,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] FINISH, HSMClearTaskVDSCommand, log id: 4f7da1cf >2014-10-01 15:53:10,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@60029c7c, log id: 1ce2ef3d >2014-10-01 15:53:10,574 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-26) [21a209d3] Initialize Irs proxy from vds: dell-r210ii-16.rhev.lab.eng.brq.redhat.com >2014-10-01 15:53:10,580 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-26) [21a209d3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host rack (Address: dell-r210ii-16.rhev.lab.eng.brq.redhat.com). >2014-10-01 15:53:10,580 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:53:10,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-16) [21a209d3] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false), log id: 72ad985d >2014-10-01 15:53:10,608 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-16) [21a209d3] -- executeIrsBrokerCommand: Attempting on storage pool e25cb031-2c3f-4070-a0e9-55237c7921ef >2014-10-01 15:53:10,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-16) [21a209d3] START, HSMGetAllTasksInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 7dcb0554 >2014-10-01 15:53:10,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-16) [21a209d3] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 7dcb0554 >2014-10-01 15:53:10,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-16) [21a209d3] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 72ad985d >2014-10-01 15:53:10,614 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-16) [21a209d3] Discovered no tasks on Storage Pool datacenter_None >2014-10-01 15:53:37,417 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-16) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:54:28,944 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-40) [40ef19b] Running command: StopVmCommand internal: false. Entities affected : ID: c1aeab18-1691-4b8c-9447-33e954c8b5fe Type: VM >2014-10-01 15:54:28,948 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-40) [40ef19b] START, DestroyVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 6d327d4f >2014-10-01 15:54:28,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-40) [40ef19b] START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=c1aeab18-1691-4b8c-9447-33e954c8b5fe, force=false, secondsToWait=0, gracefully=false), log id: 7d1c99f >2014-10-01 15:54:29,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-40) [40ef19b] FINISH, DestroyVDSCommand, log id: 7d1c99f >2014-10-01 15:54:29,535 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-40) [40ef19b] FINISH, DestroyVmVDSCommand, return: Down, log id: 6d327d4f >2014-10-01 15:54:29,536 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-42) [18a88de] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:54:29,556 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [40ef19b] Correlation ID: 40ef19b, Job ID: 26616b1a-551d-449b-b1e9-60278221c0b6, Call Stack: null, Custom Event ID: -1, Message: VM new_vm powered off by admin (Host: RHEVH). >2014-10-01 15:54:46,893 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (ajp-/127.0.0.1:8702-4) [7cec1cb5] Lock Acquired to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >, sharedLocks= ] >2014-10-01 15:54:46,975 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] Running command: DeactivateStorageDomainCommand internal: false. Entities affected : ID: 14d75c12-42cd-4215-b4a8-e2a46ee83005 Type: Storage >2014-10-01 15:54:46,995 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] START, DeactivateStorageDomainVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, storageDomainId = 14d75c12-42cd-4215-b4a8-e2a46ee83005, masterDomainId = 00000000-0000-0000-0000-000000000000, masterVersion = 1), log id: 73b02719 >2014-10-01 15:54:47,010 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeactivateStorageDomainVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] FINISH, DeactivateStorageDomainVDSCommand, log id: 73b02719 >2014-10-01 15:54:47,011 INFO [org.ovirt.engine.core.bll.storage.DeactivateStorageDomainCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] Lock freed to object EngineLock [exclusiveLocks= key: 14d75c12-42cd-4215-b4a8-e2a46ee83005 value: STORAGE >key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: POOL >, sharedLocks= ] >2014-10-01 15:54:47,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] START, SpmStopOnIrsVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false), log id: 1951ea01 >2014-10-01 15:54:47,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] START, ResetIrsVDSCommand( storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, ignoreFailoverLimit = false, vdsId = facf6428-64e1-483e-b942-6adf5fb44742, ignoreStopFailed = false), log id: 50d9f4a3 >2014-10-01 15:54:47,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] START, SpmStopVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef), log id: 58de57b >2014-10-01 15:54:47,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] SpmStopVDSCommand::Stopping SPM on vds rack, pool id e25cb031-2c3f-4070-a0e9-55237c7921ef >2014-10-01 15:54:47,168 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] FINISH, SpmStopVDSCommand, log id: 58de57b >2014-10-01 15:54:47,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] FINISH, ResetIrsVDSCommand, log id: 50d9f4a3 >2014-10-01 15:54:47,174 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SpmStopOnIrsVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] FINISH, SpmStopOnIrsVDSCommand, log id: 1951ea01 >2014-10-01 15:54:47,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] START, DisconnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1), log id: 5740c433 >2014-10-01 15:54:50,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-26) [7cec1cb5] FINISH, DisconnectStoragePoolVDSCommand, log id: 5740c433 >2014-10-01 15:54:50,943 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-28) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:54:50,945 INFO [org.ovirt.engine.core.bll.storage.DisconnectStoragePoolAsyncOperation] (org.ovirt.thread.pool-4-thread-4) [7cec1cb5] Disconnect storage pool treatment vds: RHEVH,pool datacenter_None >2014-10-01 15:54:50,945 INFO [org.ovirt.engine.core.bll.storage.DisconnectStoragePoolAsyncOperation] (org.ovirt.thread.pool-4-thread-28) [7cec1cb5] Disconnect storage pool treatment vds: rack,pool datacenter_None >2014-10-01 15:54:50,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7cec1cb5] START, DisconnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2), log id: 6a30f90f >2014-10-01 15:54:50,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-28) [7cec1cb5] START, DisconnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1), log id: 352f7e40 >2014-10-01 15:54:50,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-28) [7cec1cb5] FINISH, DisconnectStoragePoolVDSCommand, log id: 352f7e40 >2014-10-01 15:54:53,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-4) [7cec1cb5] FINISH, DisconnectStoragePoolVDSCommand, log id: 6a30f90f >2014-10-01 15:54:53,466 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-32) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:54:53,468 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-32) [7cec1cb5] After deactivate treatment vds: rack,pool datacenter_None >2014-10-01 15:54:53,468 INFO [org.ovirt.engine.core.bll.storage.AfterDeactivateSingleAsyncOperation] (org.ovirt.thread.pool-4-thread-22) [7cec1cb5] After deactivate treatment vds: RHEVH,pool datacenter_None >2014-10-01 15:54:53,471 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-32) [31534f99] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:54:53,471 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-22) [744bb09] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:54:53,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [744bb09] START, DisconnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6e6bfd6b >2014-10-01 15:54:53,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [31534f99] START, DisconnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 4a279be5 >2014-10-01 15:54:53,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-22) [744bb09] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 6e6bfd6b >2014-10-01 15:54:53,654 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-32) [31534f99] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=0}, log id: 4a279be5 >2014-10-01 15:54:53,657 INFO [org.ovirt.engine.core.bll.storage.DisconnectStorageServerConnectionCommand] (org.ovirt.thread.pool-4-thread-26) [421272af] Running command: DisconnectStorageServerConnectionCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2014-10-01 15:54:53,658 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [421272af] START, DisconnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 59ca7041-a8ae-4422-b6fb-fd4f113fdcf2, connection: 10.34.63.202:/mnt/export/nfs/lv3/pbenas/blah, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 38548059 >2014-10-01 15:54:53,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (org.ovirt.thread.pool-4-thread-26) [421272af] FINISH, DisconnectStorageServerVDSCommand, return: {59ca7041-a8ae-4422-b6fb-fd4f113fdcf2=477}, log id: 38548059 >2014-10-01 15:54:53,881 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-26) [421272af] Correlation ID: 7cec1cb5, Job ID: 6b886aeb-6bfd-4f27-84ca-cc187cc86d3b, Call Stack: null, Custom Event ID: -1, Message: Storage Domain test (Data Center datacenter_None) was deactivated by admin >2014-10-01 15:56:10,903 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-1) [7600efbd] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:10,906 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7600efbd] START, SetVdsStatusVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 78c8be59 >2014-10-01 15:56:10,911 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-1) [7600efbd] FINISH, SetVdsStatusVDSCommand, log id: 78c8be59 >2014-10-01 15:56:10,976 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-1) [7600efbd] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:10,989 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [7600efbd] Correlation ID: 7600efbd, Job ID: 1d85dff9-2c93-464b-ba15-d5243c3f39b8, Call Stack: null, Custom Event ID: -1, Message: Host rack was switched to Maintenance mode by admin. >2014-10-01 15:56:11,882 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-4) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = facf6428-64e1-483e-b942-6adf5fb44742 : rack >2014-10-01 15:56:11,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-24) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: rack. >2014-10-01 15:56:11,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-4) START, DisconnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1), log id: 3e20cbdf >2014-10-01 15:56:11,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, DisconnectStoragePoolVDSCommand, log id: 3e20cbdf >2014-10-01 15:56:11,945 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-4) [219a33f] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:56:14,493 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-9) [6142dde0] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:14,495 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [6142dde0] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 53cc7ee5 >2014-10-01 15:56:14,499 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-9) [6142dde0] FINISH, SetVdsStatusVDSCommand, log id: 53cc7ee5 >2014-10-01 15:56:14,573 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-9) [6142dde0] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:14,580 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-9) [6142dde0] Correlation ID: 6142dde0, Job ID: 2b52a180-7366-4eb2-bb2c-fbe7a985fc44, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was switched to Maintenance mode by admin. >2014-10-01 15:56:14,627 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-60) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 6cad778e-9f75-43c2-bdd5-5d25687adc9a : RHEVH >2014-10-01 15:56:14,643 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-30) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: RHEVH. >2014-10-01 15:56:14,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-60) START, DisconnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 2), log id: 2399412d >2014-10-01 15:56:14,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, DisconnectStoragePoolVDSCommand, log id: 2399412d >2014-10-01 15:56:14,652 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-60) [5d579902] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 15:56:24,822 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-8) [44fca4] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS, ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-10-01 15:56:24,829 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] START, RemoveVdsVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 2bdb7ada >2014-10-01 15:56:24,829 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [44fca4] vdsManager::disposing >2014-10-01 15:56:24,829 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] FINISH, RemoveVdsVDSCommand, log id: 2bdb7ada >2014-10-01 15:56:24,832 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] START, AddVdsVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 5003dbf5 >2014-10-01 15:56:24,832 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] AddVds - entered , starting logic to add VDS facf6428-64e1-483e-b942-6adf5fb44742 >2014-10-01 15:56:24,833 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] AddVds - VDS facf6428-64e1-483e-b942-6adf5fb44742 was added, will try to add it to the resource manager >2014-10-01 15:56:24,833 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [44fca4] Entered VdsManager constructor >2014-10-01 15:56:24,846 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [44fca4] Initialize vdsBroker (dell-r210ii-16.rhev.lab.eng.brq.redhat.com,54,321) >2014-10-01 15:56:24,847 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-8) [44fca4] VDS facf6428-64e1-483e-b942-6adf5fb44742 was added to the Resource Manager >2014-10-01 15:56:24,847 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [44fca4] FINISH, AddVdsVDSCommand, log id: 5003dbf5 >2014-10-01 15:56:24,851 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [57111b37] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:24,857 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [57111b37] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 15:56:24,873 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [7b147b8e] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:24,878 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [57111b37] Correlation ID: 44fca4, Call Stack: null, Custom Event ID: -1, Message: Host rack configuration was updated by admin. >2014-10-01 15:56:24,887 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [7b147b8e] Running command: SetupNetworksCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:24,888 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-13) [7b147b8e] No changes were detected in setup networks for host rack (ID: facf6428-64e1-483e-b942-6adf5fb44742) >2014-10-01 15:56:24,961 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:24,961 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:24,961 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-3) [5d32dfa7] Running command: UpdateVdsCommand internal: false. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:24,988 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:24,988 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-3) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:24,994 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5d32dfa7] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-10-01 15:56:25,012 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [5d32dfa7] Correlation ID: 5d32dfa7, Call Stack: null, Custom Event ID: -1, Message: Host rack configuration was updated by admin. >2014-10-01 15:56:27,851 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-22) Initializing Host: rack >2014-10-01 15:56:31,546 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-1) [403fb63a] Lock Acquired to object EngineLock [exclusiveLocks= key: facf6428-64e1-483e-b942-6adf5fb44742 value: VDS >, sharedLocks= ] >2014-10-01 15:56:31,573 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Running command: ActivateVdsCommand internal: false. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:31,573 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Before acquiring lock in order to prevent monitoring for host rack from data-center Default_foobar >2014-10-01 15:56:31,573 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Lock acquired, from now a monitoring of host will be skipped for host rack from data-center Default_foobar >2014-10-01 15:56:31,582 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] START, SetVdsStatusVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 5da11e46 >2014-10-01 15:56:31,586 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] FINISH, SetVdsStatusVDSCommand, log id: 5da11e46 >2014-10-01 15:56:31,593 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Activate finished. Lock released. Monitoring can run now for host rack from data-center Default_foobar >2014-10-01 15:56:31,597 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Correlation ID: 403fb63a, Job ID: ee6c54b3-7713-4031-9fa2-ed318dfea270, Call Stack: null, Custom Event ID: -1, Message: Host rack was activated by admin. >2014-10-01 15:56:31,600 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-25) [403fb63a] Lock freed to object EngineLock [exclusiveLocks= key: facf6428-64e1-483e-b942-6adf5fb44742 value: VDS >, sharedLocks= ] >2014-10-01 15:56:33,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GetHardwareInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]), log id: 5286e8bd >2014-10-01 15:56:33,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GetHardwareInfoVDSCommand, log id: 5286e8bd >2014-10-01 15:56:33,991 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-54) [20f3fa8c] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:34,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) [20f3fa8c] START, GetHardwareInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742]), log id: 37894fd0 >2014-10-01 15:56:34,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-54) [20f3fa8c] FINISH, GetHardwareInfoVDSCommand, log id: 37894fd0 >2014-10-01 15:56:34,099 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) [20f3fa8c] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host rack. >2014-10-01 15:56:34,143 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-54) [1442ceac] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 15:56:34,149 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 15:56:34,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] START, ConnectStorageServerVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6b0ae979 >2014-10-01 15:56:39,329 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 6b0ae979 >2014-10-01 15:56:39,330 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] Host rack storage connection was succeeded >2014-10-01 15:56:39,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-27) START, ConnectStoragePoolVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 1, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: 1d4a70cb >2014-10-01 15:56:39,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-27) FINISH, ConnectStoragePoolVDSCommand, log id: 1d4a70cb >2014-10-01 15:56:39,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] START, SetMOMPolicyParametersVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 185dd88b >2014-10-01 15:56:39,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-54) [1072ec27] FINISH, SetMOMPolicyParametersVDSCommand, log id: 185dd88b >2014-10-01 15:56:40,004 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-54) [1072ec27] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host rack. >2014-10-01 15:56:40,011 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-54) [178c36c7] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: facf6428-64e1-483e-b942-6adf5fb44742 Type: VDS >2014-10-01 15:56:42,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) hostFromVds::selectedVds - rack, spmStatus Free, storage pool Default_foobar >2014-10-01 15:56:42,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) starting spm on vds rack, storage pool Default_foobar, prevId -1, LVER 10 >2014-10-01 15:56:42,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-84) START, SpmStartVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, storagePoolId = 00000002-0002-0002-0002-000000000135, prevId=-1, prevLVER=10, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1349320b >2014-10-01 15:56:42,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-84) spmStart polling started: taskId = 4ae5564d-adef-434d-bf2a-c7c3eade7b8a >2014-10-01 15:56:43,232 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS, ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-10-01 15:56:43,239 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] START, RemoveVdsVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 44c44e3e >2014-10-01 15:56:43,239 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [4d31e7f9] vdsManager::disposing >2014-10-01 15:56:43,241 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] FINISH, RemoveVdsVDSCommand, log id: 44c44e3e >2014-10-01 15:56:43,243 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] START, AddVdsVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 10808c4b >2014-10-01 15:56:43,243 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] AddVds - entered , starting logic to add VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a >2014-10-01 15:56:43,244 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] AddVds - VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a was added, will try to add it to the resource manager >2014-10-01 15:56:43,244 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [4d31e7f9] Entered VdsManager constructor >2014-10-01 15:56:43,262 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-9) [4d31e7f9] Initialize vdsBroker (10.34.62.205,54,321) >2014-10-01 15:56:43,263 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-9) [4d31e7f9] VDS 6cad778e-9f75-43c2-bdd5-5d25687adc9a was added to the Resource Manager >2014-10-01 15:56:43,264 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-9) [4d31e7f9] FINISH, AddVdsVDSCommand, log id: 10808c4b >2014-10-01 15:56:43,268 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [65b61067] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:43,277 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-9) [65b61067] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 15:56:43,294 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-32) [1b2176bd] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:43,300 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) [65b61067] Correlation ID: 4d31e7f9, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH configuration was updated by admin. >2014-10-01 15:56:43,312 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-32) [1b2176bd] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:43,313 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-32) [1b2176bd] No changes were detected in setup networks for host RHEVH (ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a) >2014-10-01 15:56:43,379 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:43,379 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:43,380 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-11) [34083bec] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:43,384 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:43,384 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-11) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 15:56:43,390 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [34083bec] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:56:43,395 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [34083bec] Correlation ID: 34083bec, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH configuration was updated by admin. >2014-10-01 15:56:44,612 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-4) [6224752f] Lock Acquired to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:56:44,632 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:44,632 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] Before acquiring lock in order to prevent monitoring for host RHEVH from data-center Default_foobar >2014-10-01 15:56:44,632 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] Lock acquired, from now a monitoring of host will be skipped for host RHEVH from data-center Default_foobar >2014-10-01 15:56:44,650 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] START, SetVdsStatusVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 95e7fed >2014-10-01 15:56:44,654 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] FINISH, SetVdsStatusVDSCommand, log id: 95e7fed >2014-10-01 15:56:44,667 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] Activate finished. Lock released. Monitoring can run now for host RHEVH from data-center Default_foobar >2014-10-01 15:56:44,672 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [6224752f] Correlation ID: 6224752f, Job ID: e55ba653-9f35-4082-b44c-dad7e72e4369, Call Stack: null, Custom Event ID: -1, Message: Host RHEVH was activated by admin. >2014-10-01 15:56:44,676 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-43) [6224752f] Lock freed to object EngineLock [exclusiveLocks= key: 6cad778e-9f75-43c2-bdd5-5d25687adc9a value: VDS >, sharedLocks= ] >2014-10-01 15:56:46,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 7a85fb6d >2014-10-01 15:56:46,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GetHardwareInfoVDSCommand, log id: 7a85fb6d >2014-10-01 15:56:46,402 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-56) [7d5137e6] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:56:46,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-56) [7d5137e6] START, GetHardwareInfoVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a]), log id: 68ceea5b >2014-10-01 15:56:46,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-56) [7d5137e6] FINISH, GetHardwareInfoVDSCommand, log id: 68ceea5b >2014-10-01 15:56:46,532 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) [7d5137e6] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host RHEVH. >2014-10-01 15:56:46,538 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-56) [72536ecb] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 15:56:46,544 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 15:56:46,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] START, ConnectStorageServerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3b074e76 >2014-10-01 15:56:46,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 3b074e76 >2014-10-01 15:56:46,785 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] Host RHEVH storage connection was succeeded >2014-10-01 15:56:46,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-12) START, ConnectStoragePoolVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 2, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: 596e2d5e >2014-10-01 15:56:48,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-12) FINISH, ConnectStoragePoolVDSCommand, log id: 596e2d5e >2014-10-01 15:56:48,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] START, SetMOMPolicyParametersVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a), log id: 532a6f49 >2014-10-01 15:56:48,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] FINISH, SetMOMPolicyParametersVDSCommand, log id: 532a6f49 >2014-10-01 15:56:48,637 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host RHEVH. >2014-10-01 15:56:48,643 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-56) [72bb8ecd] Initializing Host: RHEVH >2014-10-01 15:56:48,645 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-56) [72a34578] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 6cad778e-9f75-43c2-bdd5-5d25687adc9a Type: VDS >2014-10-01 15:57:02,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-84) spmStart polling ended: taskId = 4ae5564d-adef-434d-bf2a-c7c3eade7b8a task status = finished >2014-10-01 15:57:02,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-84) spmStart polling ended, spm status: SPM >2014-10-01 15:57:02,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-84) START, HSMClearTaskVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, taskId=4ae5564d-adef-434d-bf2a-c7c3eade7b8a), log id: 7c6c6069 >2014-10-01 15:57:02,695 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, HSMClearTaskVDSCommand, log id: 7c6c6069 >2014-10-01 15:57:02,695 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2b9ad5fd, log id: 1349320b >2014-10-01 15:57:02,698 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler_Worker-84) Initialize Irs proxy from vds: dell-r210ii-16.rhev.lab.eng.brq.redhat.com >2014-10-01 15:57:02,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-84) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Storage Pool Manager runs on Host rack (Address: dell-r210ii-16.rhev.lab.eng.brq.redhat.com). >2014-10-01 15:57:02,706 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-17) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:57:02,713 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 00000002-0002-0002-0002-000000000135, ignoreFailoverLimit = false), log id: 13138224 >2014-10-01 15:57:02,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-17) -- executeIrsBrokerCommand: Attempting on storage pool 00000002-0002-0002-0002-000000000135 >2014-10-01 15:57:02,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-17) START, HSMGetAllTasksInfoVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742), log id: 719b274a >2014-10-01 15:57:02,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 719b274a >2014-10-01 15:57:02,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (org.ovirt.thread.pool-4-thread-17) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 13138224 >2014-10-01 15:57:02,765 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (org.ovirt.thread.pool-4-thread-17) Discovered no tasks on Storage Pool Default_foobar >2014-10-01 15:57:27,194 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-4) [35d0cdde] Lock Acquired to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-10-01 15:57:27,215 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-4) [35d0cdde] Running command: UpdateVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM, ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 15:57:27,230 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [35d0cdde] Correlation ID: 35d0cdde, Job ID: c3bf8457-06f6-4012-bfda-42e2ce938e8e, Call Stack: null, Custom Event ID: -1, Message: VM dalsi configuration was updated by admin. >2014-10-01 15:57:27,233 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-4) [35d0cdde] Lock freed to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-10-01 15:57:29,656 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-2) [384a4f2b] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:57:29,681 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [384a4f2b] START, IsVmDuringInitiatingVDSCommand( vmId = a50e8ea6-38ce-4875-ae04-b0f4aff74534), log id: 1f6d6828 >2014-10-01 15:57:29,681 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-2) [384a4f2b] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 1f6d6828 >2014-10-01 15:57:29,719 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] Running command: RunVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 15:57:29,752 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] START, CreateVmVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 13a2f81a >2014-10-01 15:57:29,755 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] START, CreateVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: ce7b3f1 >2014-10-01 15:57:29,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=b6ef70ed-b5fe-438d-a047-ca774d97b650}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6e39ef6c-7c3e-4b35-8894-344fe08abdc4}, {shared=false, index=0, volumeID=59b771e5-a0d8-40ab-ba94-c10e44a82eec, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=2, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=b4b4d9d0-e202-4a50-a3aa-520aed2fd057, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=b4b4d9d0-e202-4a50-a3aa-520aed2fd057}, {shared=false, volumeID=9fc7a631-0a2d-4000-96d7-7d8080b8b091, iface=virtio, imageID=dfb71e18-fd2e-4957-9438-0d21d0d37fab, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, address={bus=0x00, domain=0x0000, slot=0x08, type=pci, function=0x0}, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=00000002-0002-0002-0002-000000000135, format=raw, type=disk, readonly=false, deviceId=dfb71e18-fd2e-4957-9438-0d21d0d37fab}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0e, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=c294099f-e42c-4d67-b0a8-a168dd4db5fd}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=90304153-6961-466f-8614-e91f7a9aaa78}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=4827014f-a8bd-4905-8b89-dd04b3462ed7}],acpiEnable=true,vmName=dalsi,cpuType=Westmere,custom={device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=186feec9-022d-4c3e-97f7-03d551b69c95, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0a83d2c5-f73b-4420-bda4-ab4d101000d9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560device_090a6fc2-ad12-4aca-8c12-372ab97ddc1d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=090a6fc2-ad12-4aca-8c12-372ab97ddc1d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=90245834-04d1-44ff-850c-f69dcdde7560, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=40d34c53-99e2-4fa0-910e-ac06b7d956d3, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0db324ad-dc0a-4f7c-a72e-256caf805bd0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}} >2014-10-01 15:57:29,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] FINISH, CreateVDSCommand, log id: ce7b3f1 >2014-10-01 15:57:29,857 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 13a2f81a >2014-10-01 15:57:29,857 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:57:29,863 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-1) [384a4f2b] Correlation ID: 384a4f2b, Job ID: 8a4c21f4-2f35-4951-ad36-b75574dafd07, Call Stack: null, Custom Event ID: -1, Message: VM dalsi was started by admin (Host: rack). >2014-10-01 15:57:31,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) START, DestroyVDSCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: 56684958 >2014-10-01 15:57:31,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, DestroyVDSCommand, log id: 56684958 >2014-10-01 15:57:31,585 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-87) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM dalsi is down. Exit message: Child quit during startup handshake: Input/output error. >2014-10-01 15:57:31,585 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) Running on vds during rerun failed vm: null >2014-10-01 15:57:31,587 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) VM dalsi (a50e8ea6-38ce-4875-ae04-b0f4aff74534) is running in db and not running in VDS rack >2014-10-01 15:57:31,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-87) START, FullListVdsCommand(HostName = rack, HostId = facf6428-64e1-483e-b942-6adf5fb44742, vds=Host[rack,facf6428-64e1-483e-b942-6adf5fb44742], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 6881bc4e >2014-10-01 15:57:31,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-87) FINISH, FullListVdsCommand, return: [], log id: 6881bc4e >2014-10-01 15:57:31,641 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-87) Rerun vm a50e8ea6-38ce-4875-ae04-b0f4aff74534. Called from vds rack >2014-10-01 15:57:31,642 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-10) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 15:57:31,647 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) Correlation ID: 384a4f2b, Job ID: 8a4c21f4-2f35-4951-ad36-b75574dafd07, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM dalsi on Host rack. >2014-10-01 15:57:31,656 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-10) Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:57:31,677 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, IsVmDuringInitiatingVDSCommand( vmId = a50e8ea6-38ce-4875-ae04-b0f4aff74534), log id: 5e08876 >2014-10-01 15:57:31,677 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5e08876 >2014-10-01 15:57:31,695 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-10) Running command: RunVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 15:57:31,726 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, CreateVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 12d4581e >2014-10-01 15:57:31,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-10) START, CreateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 1a32be7d >2014-10-01 15:57:31,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-10) org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=b6ef70ed-b5fe-438d-a047-ca774d97b650}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6e39ef6c-7c3e-4b35-8894-344fe08abdc4}, {shared=false, index=0, volumeID=59b771e5-a0d8-40ab-ba94-c10e44a82eec, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=2, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=b4b4d9d0-e202-4a50-a3aa-520aed2fd057, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=b4b4d9d0-e202-4a50-a3aa-520aed2fd057}, {shared=false, volumeID=9fc7a631-0a2d-4000-96d7-7d8080b8b091, iface=virtio, imageID=dfb71e18-fd2e-4957-9438-0d21d0d37fab, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, address={bus=0x00, domain=0x0000, slot=0x08, type=pci, function=0x0}, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=00000002-0002-0002-0002-000000000135, format=raw, type=disk, readonly=false, deviceId=dfb71e18-fd2e-4957-9438-0d21d0d37fab}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0e, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=c294099f-e42c-4d67-b0a8-a168dd4db5fd}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=90304153-6961-466f-8614-e91f7a9aaa78}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=4827014f-a8bd-4905-8b89-dd04b3462ed7}],acpiEnable=true,vmName=dalsi,cpuType=Westmere,custom={device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=186feec9-022d-4c3e-97f7-03d551b69c95, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0a83d2c5-f73b-4420-bda4-ab4d101000d9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560device_090a6fc2-ad12-4aca-8c12-372ab97ddc1d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=090a6fc2-ad12-4aca-8c12-372ab97ddc1d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=90245834-04d1-44ff-850c-f69dcdde7560, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=40d34c53-99e2-4fa0-910e-ac06b7d956d3, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0db324ad-dc0a-4f7c-a72e-256caf805bd0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}} >2014-10-01 15:57:31,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, CreateVDSCommand, log id: 1a32be7d >2014-10-01 15:57:31,799 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-10) FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 12d4581e >2014-10-01 15:57:31,799 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-10) Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:57:31,802 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-10) Correlation ID: 384a4f2b, Job ID: 8a4c21f4-2f35-4951-ad36-b75574dafd07, Call Stack: null, Custom Event ID: -1, Message: VM dalsi was started by admin (Host: RHEVH). >2014-10-01 15:57:34,017 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-74) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from WaitForLaunch --> PoweringUp >2014-10-01 15:57:34,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-74) START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 4bdf27c2 >2014-10-01 15:57:34,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-74) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=186feec9-022d-4c3e-97f7-03d551b69c95, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0a83d2c5-f73b-4420-bda4-ab4d101000d9, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560device_090a6fc2-ad12-4aca-8c12-372ab97ddc1d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=090a6fc2-ad12-4aca-8c12-372ab97ddc1d, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0device_186feec9-022d-4c3e-97f7-03d551b69c95device_0a83d2c5-f73b-4420-bda4-ab4d101000d9device_90245834-04d1-44ff-850c-f69dcdde7560=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=90245834-04d1-44ff-850c-f69dcdde7560, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=40d34c53-99e2-4fa0-910e-ac06b7d956d3, device=memballoon, type=BALLOON, bootOrder=0, specParams={model=virtio}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=balloon0, customProperties={}, snapshotId=null}, device_40d34c53-99e2-4fa0-910e-ac06b7d956d3device_0db324ad-dc0a-4f7c-a72e-256caf805bd0=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=0db324ad-dc0a-4f7c-a72e-256caf805bd0, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Up, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=32310, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=, devices=[Ljava.lang.Object;@27ab5878, vmName=dalsi, cpuType=Westmere}], log id: 4bdf27c2 >2014-10-01 15:58:03,458 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (ajp-/127.0.0.1:8702-2) [1d4b2cba] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:58:03,543 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] Running command: MigrateVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 15:58:03,578 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 1561cb39 >2014-10-01 15:58:03,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] VdsBroker::migrate::Entered (vm_guid=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, method=online >2014-10-01 15:58:03,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstVdsId=facf6428-64e1-483e-b942-6adf5fb44742, dstHost=dell-r210ii-16.rhev.lab.eng.brq.redhat.com:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 7b38418c >2014-10-01 15:58:03,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] FINISH, MigrateBrokerVDSCommand, log id: 7b38418c >2014-10-01 15:58:03,594 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 1561cb39 >2014-10-01 15:58:03,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-16) [1d4b2cba] Correlation ID: 1d4b2cba, Job ID: 4d41271a-9ade-46f2-91d4-72532a1f3e9a, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: dalsi, Source: RHEVH, Destination: rack, User: admin). >2014-10-01 15:58:04,359 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from MigratingFrom --> PoweringUp >2014-10-01 15:58:04,359 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) Adding VM a50e8ea6-38ce-4875-ae04-b0f4aff74534 to re-run list >2014-10-01 15:58:04,382 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-44) Rerun vm a50e8ea6-38ce-4875-ae04-b0f4aff74534. Called from vds RHEVH >2014-10-01 15:58:04,391 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) Correlation ID: 1d4b2cba, Job ID: 4d41271a-9ade-46f2-91d4-72532a1f3e9a, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: dalsi, Source: RHEVH, Destination: rack). >2014-10-01 15:58:04,392 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-8) [22d0597b] Running command: ProcessDownVmCommand internal: true. >2014-10-01 15:58:04,394 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (org.ovirt.thread.pool-4-thread-22) Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 15:58:34,623 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-30) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from PoweringUp --> Up >2014-10-01 15:59:17,190 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [75500a32] Running command: SetVmTicketCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 15:59:17,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [75500a32] START, SetVmTicketVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, ticket=05bREXf02tjg, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1ffae4bc >2014-10-01 15:59:17,207 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [75500a32] FINISH, SetVmTicketVDSCommand, log id: 1ffae4bc >2014-10-01 15:59:17,216 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [75500a32] Correlation ID: 75500a32, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM dalsi >2014-10-01 15:59:35,234 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-4) [219a33f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM dalsi. >2014-10-01 16:03:06,377 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-5) [10ae8fca] Running command: AddVdsCommand internal: false. Entities affected : ID: fe341111-e8cd-4772-9def-9d25e073ca3b Type: VdsGroups >2014-10-01 16:03:06,389 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:03:06,394 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] Lock freed to object EngineLock [exclusiveLocks= key: e25cb031-2c3f-4070-a0e9-55237c7921ef value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 16:03:06,396 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] START, RemoveVdsVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7), log id: 60fe6f2e >2014-10-01 16:03:06,396 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] FINISH, RemoveVdsVDSCommand, log id: 60fe6f2e >2014-10-01 16:03:06,398 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] START, AddVdsVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7), log id: af6e0ee >2014-10-01 16:03:06,398 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] AddVds - entered , starting logic to add VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 >2014-10-01 16:03:06,399 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] AddVds - VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 was added, will try to add it to the resource manager >2014-10-01 16:03:06,399 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [417f2d63] Entered VdsManager constructor >2014-10-01 16:03:06,411 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-5) [417f2d63] Initialize vdsBroker (10.34.61.107,54,321) >2014-10-01 16:03:06,412 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-5) [417f2d63] VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 was added to the Resource Manager >2014-10-01 16:03:06,412 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-5) [417f2d63] FINISH, AddVdsVDSCommand, log id: af6e0ee >2014-10-01 16:03:06,417 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [417f2d63] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host Host3-polo. >2014-10-01 16:03:06,440 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) [417f2d63] Correlation ID: 10ae8fca, Job ID: 65cb1bcf-c4c0-423b-8f71-29c63ed2a4db, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo was added by admin. >2014-10-01 16:03:06,445 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Lock Acquired to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:03:06,451 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Running command: InstallVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:03:06,451 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Before Installation host 1958d5db-c7d0-4c26-a04b-f194ae7620f7, Host3-polo >2014-10-01 16:03:06,455 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1fb8144c >2014-10-01 16:03:06,459 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] FINISH, SetVdsStatusVDSCommand, log id: 1fb8144c >2014-10-01 16:03:06,528 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Installation 10.34.61.107: Connected to host 10.34.61.107 with SSH key fingerprint: 4e:56:f3:99:8d:a7:82:06:e3:98:0c:e2:85:b2:f3:f1 >2014-10-01 16:03:06,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Connected to host 10.34.61.107 with SSH key fingerprint: 4e:56:f3:99:8d:a7:82:06:e3:98:0c:e2:85:b2:f3:f1. >2014-10-01 16:03:06,562 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Installation of 10.34.61.107. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-01 16:03:06,575 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-40) SSH execute root@10.34.61.107 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-01 16:03:08,077 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Initializing >2014-10-01 16:03:08,083 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Initializing. >2014-10-01 16:03:08,103 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Environment setup >2014-10-01 16:03:08,110 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Environment setup. >2014-10-01 16:03:08,126 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Environment packages setup >2014-10-01 16:03:08,132 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Environment packages setup. >2014-10-01 16:03:09,415 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-100) Initializing Host: Host3-polo >2014-10-01 16:03:20,830 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Programs detection >2014-10-01 16:03:20,837 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Programs detection. >2014-10-01 16:03:20,837 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Environment customization >2014-10-01 16:03:20,843 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Environment customization. >2014-10-01 16:03:20,881 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Logs at host located at: '/tmp/ovirt-host-deploy-20141001160306-wzw2y6.log' >2014-10-01 16:03:20,887 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Logs at host located at: '/tmp/ovirt-host-deploy-20141001160306-wzw2y6.log'. >2014-10-01 16:03:20,940 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.61.107 reports unique id 53E4DB08-2A10-451B-8B70-8968766830E9 >2014-10-01 16:03:20,942 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 53E4DB08-2A10-451B-8B70-8968766830E9 to Host 10.34.61.107 >2014-10-01 16:03:21,029 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Setup validation >2014-10-01 16:03:21,036 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Setup validation. >2014-10-01 16:03:21,050 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Cannot validate host name settings, reason: resolved host does not match any of the local addresses >2014-10-01 16:03:21,057 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo installation in progress . Cannot validate host name settings, reason: resolved host does not match any of the local addresses. >2014-10-01 16:03:21,062 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Machine does not support constant timestamp counter, this may effect performance >2014-10-01 16:03:21,067 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo installation in progress . Machine does not support constant timestamp counter, this may effect performance. >2014-10-01 16:03:21,074 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Hardware supports virtualization >2014-10-01 16:03:21,079 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Hardware supports virtualization. >2014-10-01 16:03:21,900 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Transaction setup >2014-10-01 16:03:21,906 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Transaction setup. >2014-10-01 16:03:21,992 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Misc configuration >2014-10-01 16:03:21,997 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Misc configuration. >2014-10-01 16:03:21,997 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Package installation >2014-10-01 16:03:22,002 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Package installation. >2014-10-01 16:03:33,076 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Misc configuration >2014-10-01 16:03:33,081 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Misc configuration. >2014-10-01 16:03:33,112 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Setting time >2014-10-01 16:03:33,118 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Setting time. >2014-10-01 16:03:35,210 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Enrolling certificate >2014-10-01 16:03:35,218 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Enrolling certificate. >2014-10-01 16:03:36,357 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Transaction commit >2014-10-01 16:03:36,364 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Transaction commit. >2014-10-01 16:03:36,502 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Closing up >2014-10-01 16:03:36,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Closing up. >2014-10-01 16:03:37,647 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stopping libvirtd >2014-10-01 16:03:37,656 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stopping libvirtd. >2014-10-01 16:03:38,150 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Starting vdsm >2014-10-01 16:03:38,159 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Starting vdsm. >2014-10-01 16:03:40,909 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Pre-termination >2014-10-01 16:03:40,915 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Pre-termination. >2014-10-01 16:03:40,934 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001160340-10.34.61.107-5f94d948.log' >2014-10-01 16:03:40,940 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001160340-10.34.61.107-5f94d948.log'. >2014-10-01 16:03:41,296 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.61.107: Stage: Termination >2014-10-01 16:03:41,303 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5f94d948, Call Stack: null, Custom Event ID: -1, Message: Installing Host Host3-polo. Stage: Termination. >2014-10-01 16:03:41,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-01 16:03:41,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-10-01 16:03:41,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:41,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:42,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:42,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:43,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:43,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:43,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:43,520 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:44,026 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:44,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Command PollVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:03:44,534 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Engine managed to communicate with VDSM agent on host Host3-polo >2014-10-01 16:03:44,916 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 522f2a36 >2014-10-01 16:03:44,920 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] FINISH, SetVdsStatusVDSCommand, log id: 522f2a36 >2014-10-01 16:03:44,920 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] After Installation host Host3-polo, VDS >2014-10-01 16:03:44,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Correlation ID: 5f94d948, Job ID: 65cb1bcf-c4c0-423b-8f71-29c63ed2a4db, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo installed >2014-10-01 16:03:44,931 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-40) [5f94d948] Lock freed to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:03:45,503 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 53e97b2a >2014-10-01 16:03:45,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GetHardwareInfoVDSCommand, log id: 53e97b2a >2014-10-01 16:03:45,773 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-37) [397addc8] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:03:45,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-37) [397addc8] START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 28ac07c >2014-10-01 16:03:45,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-37) [397addc8] FINISH, GetHardwareInfoVDSCommand, log id: 28ac07c >2014-10-01 16:03:45,894 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-37) [397addc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host Host3-polo. >2014-10-01 16:03:45,940 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-37) [3183c148] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 16:03:45,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-37) [3183c148] START, SetMOMPolicyParametersVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7), log id: 42f36c89 >2014-10-01 16:03:46,072 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-37) [3183c148] FINISH, SetMOMPolicyParametersVDSCommand, log id: 42f36c89 >2014-10-01 16:03:46,077 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-37) [3183c148] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host Host3-polo. >2014-10-01 16:03:46,085 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-37) [9e1984a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:03:46,092 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-37) [7de05b36] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:11,916 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (org.ovirt.thread.pool-4-thread-43) [d104ef2] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:11,919 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [d104ef2] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=PreparingForMaintenance, nonOperationalReason=NONE, stopSpmFailureLogged=true), log id: 63e7aadc >2014-10-01 16:04:11,922 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-43) [d104ef2] FINISH, SetVdsStatusVDSCommand, log id: 63e7aadc >2014-10-01 16:04:11,982 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (org.ovirt.thread.pool-4-thread-43) [d104ef2] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:11,987 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-43) [d104ef2] Correlation ID: d104ef2, Job ID: c64e417f-6967-4f1e-9075-26438391b5a1, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo was switched to Maintenance mode by admin. >2014-10-01 16:04:13,439 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 1958d5db-c7d0-4c26-a04b-f194ae7620f7 : Host3-polo >2014-10-01 16:04:13,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (org.ovirt.thread.pool-4-thread-17) Clearing cache of pool: e25cb031-2c3f-4070-a0e9-55237c7921ef for problematic entities of VDS: Host3-polo. >2014-10-01 16:04:13,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) START, DisconnectStoragePoolVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, storagePoolId = e25cb031-2c3f-4070-a0e9-55237c7921ef, vds_spm_id = 1), log id: 1d27f1fe >2014-10-01 16:04:13,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, DisconnectStoragePoolVDSCommand, log id: 1d27f1fe >2014-10-01 16:04:13,500 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-71) [59daf294] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: e25cb031-2c3f-4070-a0e9-55237c7921ef Type: StoragePool >2014-10-01 16:04:26,741 INFO [org.ovirt.engine.core.bll.ChangeVDSClusterCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] Running command: ChangeVDSClusterCommand internal: false. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS, ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-10-01 16:04:26,753 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] START, RemoveVdsVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7), log id: 3c38232a >2014-10-01 16:04:26,753 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [1e20ed2f] vdsManager::disposing >2014-10-01 16:04:26,753 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] FINISH, RemoveVdsVDSCommand, log id: 3c38232a >2014-10-01 16:04:26,755 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] START, AddVdsVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7), log id: 7f2c59ed >2014-10-01 16:04:26,755 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] AddVds - entered , starting logic to add VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 >2014-10-01 16:04:26,757 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] AddVds - VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 was added, will try to add it to the resource manager >2014-10-01 16:04:26,757 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [1e20ed2f] Entered VdsManager constructor >2014-10-01 16:04:26,769 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-8) [1e20ed2f] Initialize vdsBroker (10.34.61.107,54,321) >2014-10-01 16:04:26,770 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-8) [1e20ed2f] VDS 1958d5db-c7d0-4c26-a04b-f194ae7620f7 was added to the Resource Manager >2014-10-01 16:04:26,770 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-8) [1e20ed2f] FINISH, AddVdsVDSCommand, log id: 7f2c59ed >2014-10-01 16:04:26,864 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [9a7b4f8] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:26,869 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-8) [9a7b4f8] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 16:04:26,884 INFO [org.ovirt.engine.core.bll.network.host.PersistentSetupNetworksCommand] (org.ovirt.thread.pool-4-thread-28) [5e1a1277] Running command: PersistentSetupNetworksCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:26,897 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-28) [5e1a1277] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:26,897 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (org.ovirt.thread.pool-4-thread-28) [5e1a1277] No changes were detected in setup networks for host Host3-polo (ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7) >2014-10-01 16:04:26,897 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [9a7b4f8] Correlation ID: 1e20ed2f, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo configuration was updated by admin. >2014-10-01 16:04:26,970 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:04:26,971 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:04:26,971 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-6) [3af16605] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:27,010 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:04:27,010 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:04:27,017 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [3af16605] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host Host3-polo. >2014-10-01 16:04:27,022 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [3af16605] Correlation ID: 3af16605, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo configuration was updated by admin. >2014-10-01 16:04:29,773 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-82) Initializing Host: Host3-polo >2014-10-01 16:04:31,704 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-7) [4d09b38c] Lock Acquired to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:04:31,726 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:31,726 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Before acquiring lock in order to prevent monitoring for host Host3-polo from data-center Default_foobar >2014-10-01 16:04:31,726 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Lock acquired, from now a monitoring of host will be skipped for host Host3-polo from data-center Default_foobar >2014-10-01 16:04:31,735 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 58a4340a >2014-10-01 16:04:31,742 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] FINISH, SetVdsStatusVDSCommand, log id: 58a4340a >2014-10-01 16:04:31,803 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Activate finished. Lock released. Monitoring can run now for host Host3-polo from data-center Default_foobar >2014-10-01 16:04:31,830 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Correlation ID: 4d09b38c, Job ID: 1b5bc4b2-f9e0-445b-ae20-d51e59f10407, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo was activated by admin. >2014-10-01 16:04:31,835 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (org.ovirt.thread.pool-4-thread-22) [4d09b38c] Lock freed to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:04:32,846 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 42cd2504 >2014-10-01 16:04:32,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GetHardwareInfoVDSCommand, log id: 42cd2504 >2014-10-01 16:04:32,928 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-25) [39558a40] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:32,951 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-25) [7c14f816] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:32,954 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-25) [7c14f816] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=NonOperational, nonOperationalReason=CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 40f11bce >2014-10-01 16:04:32,958 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-25) [7c14f816] FINISH, SetVdsStatusVDSCommand, log id: 40f11bce >2014-10-01 16:04:32,973 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [7c14f816] Correlation ID: 7c14f816, Job ID: 84cb97d8-51cc-4748-877a-d83cba6ced93, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state. >2014-10-01 16:04:32,993 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [7c14f816] Correlation ID: 39558a40, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state as host does not meet the cluster's minimum CPU level. Missing CPU features : aes, model_Westmere >2014-10-01 16:04:33,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) [7c14f816] START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 64a542bf >2014-10-01 16:04:33,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-25) [7c14f816] FINISH, GetHardwareInfoVDSCommand, log id: 64a542bf >2014-10-01 16:04:33,113 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-25) [42344c9a] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:33,130 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-25) [7cbd6173] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:33,132 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-25) [7cbd6173] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=NonOperational, nonOperationalReason=CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 290dd4fa >2014-10-01 16:04:33,135 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-25) [7cbd6173] FINISH, SetVdsStatusVDSCommand, log id: 290dd4fa >2014-10-01 16:04:33,148 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [7cbd6173] Correlation ID: 42344c9a, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state as host does not meet the cluster's minimum CPU level. Missing CPU features : aes, model_Westmere >2014-10-01 16:04:33,157 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-25) [7cbd6173] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host Host3-polo. >2014-10-01 16:04:33,172 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-25) [2708bed] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:04:33,174 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-25) [2708bed] Host 1958d5db-c7d0-4c26-a04b-f194ae7620f7 : Host3-polo is already in NonOperational status for reason CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-01 16:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) Autorecovering 1 hosts >2014-10-01 16:05:00,013 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-79) Autorecovering hosts id: 1958d5db-c7d0-4c26-a04b-f194ae7620f7, name : Host3-polo >2014-10-01 16:05:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Lock Acquired to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:05:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:05:00,015 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Before acquiring lock in order to prevent monitoring for host Host3-polo from data-center Default_foobar >2014-10-01 16:05:00,016 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Lock acquired, from now a monitoring of host will be skipped for host Host3-polo from data-center Default_foobar >2014-10-01 16:05:00,025 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 1d17b5d7 >2014-10-01 16:05:00,029 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] FINISH, SetVdsStatusVDSCommand, log id: 1d17b5d7 >2014-10-01 16:05:00,073 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Activate finished. Lock released. Monitoring can run now for host Host3-polo from data-center Default_foobar >2014-10-01 16:05:00,078 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Correlation ID: 7f709f4e, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo was autorecovered. >2014-10-01 16:05:00,078 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-79) [7f709f4e] Lock freed to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:05:00,255 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 5c103681 >2014-10-01 16:05:00,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GetHardwareInfoVDSCommand, log id: 5c103681 >2014-10-01 16:05:00,323 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-65) [39898c39] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:05:00,341 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-65) [6da7e03f] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:05:00,343 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-65) [6da7e03f] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=NonOperational, nonOperationalReason=CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 1f9dd30e >2014-10-01 16:05:00,346 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-65) [6da7e03f] FINISH, SetVdsStatusVDSCommand, log id: 1f9dd30e >2014-10-01 16:05:00,359 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [6da7e03f] Correlation ID: 39898c39, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state as host does not meet the cluster's minimum CPU level. Missing CPU features : aes, model_Westmere >2014-10-01 16:05:00,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-65) [6da7e03f] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host Host3-polo. >2014-10-01 16:05:00,377 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-65) [2a607e4f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:05:00,379 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-65) [2a607e4f] Host 1958d5db-c7d0-4c26-a04b-f194ae7620f7 : Host3-polo is already in NonOperational status for reason CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-01 16:07:38,659 INFO [org.ovirt.engine.core.bll.StopVmCommand] (org.ovirt.thread.pool-4-thread-12) [22b9971a] Running command: StopVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:07:38,664 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-12) [22b9971a] START, DestroyVmVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: 3ba265c6 >2014-10-01 16:07:38,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-12) [22b9971a] START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: 53a7d0a6 >2014-10-01 16:07:39,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (org.ovirt.thread.pool-4-thread-12) [22b9971a] FINISH, DestroyVDSCommand, log id: 53a7d0a6 >2014-10-01 16:07:39,270 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (org.ovirt.thread.pool-4-thread-12) [22b9971a] FINISH, DestroyVmVDSCommand, return: Down, log id: 3ba265c6 >2014-10-01 16:07:39,271 INFO [org.ovirt.engine.core.bll.ProcessDownVmCommand] (org.ovirt.thread.pool-4-thread-46) [3ecd3d99] Running command: ProcessDownVmCommand internal: true. >2014-10-01 16:07:39,279 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-12) [22b9971a] Correlation ID: 22b9971a, Job ID: 5259837c-e42d-4d1f-a945-ac4a0251ddc3, Call Stack: null, Custom Event ID: -1, Message: VM dalsi powered off by admin (Host: RHEVH). >2014-10-01 16:07:58,132 INFO [org.ovirt.engine.core.services.RegisterServlet] (ajp-/127.0.0.1:8702-7) Registration request: source='10.34.63.138', secured='true', address='10.34.63.138', vdsPort=54321, name='slot-8.rhev.lab.eng.brq.redhat.com', uniqueId='4C4C4544-0052-4C10-8058-B3C04F43354A' >2014-10-01 16:07:58,170 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-7) Running Command: RegisterVds >2014-10-01 16:07:58,289 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (ajp-/127.0.0.1:8702-7) [16a6e4] Running command: AddVdsCommand internal: true. Entities affected : ID: 00000001-0001-0001-0001-00000000004b Type: VdsGroups >2014-10-01 16:07:58,305 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:07:58,309 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] Lock freed to object EngineLock [exclusiveLocks= key: 00000002-0002-0002-0002-000000000135 value: REGISTER_VDS >, sharedLocks= ] >2014-10-01 16:07:58,311 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] START, RemoveVdsVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af), log id: 617e8595 >2014-10-01 16:07:58,311 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] FINISH, RemoveVdsVDSCommand, log id: 617e8595 >2014-10-01 16:07:58,312 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] START, AddVdsVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af), log id: 4e152126 >2014-10-01 16:07:58,313 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] AddVds - entered , starting logic to add VDS 90128077-83e6-4de8-9507-5f84e162d7af >2014-10-01 16:07:58,314 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] AddVds - VDS 90128077-83e6-4de8-9507-5f84e162d7af was added, will try to add it to the resource manager >2014-10-01 16:07:58,314 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [2ae087bd] Entered VdsManager constructor >2014-10-01 16:07:58,331 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ajp-/127.0.0.1:8702-7) [2ae087bd] Initialize vdsBroker (10.34.63.138,54,321) >2014-10-01 16:07:58,331 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ajp-/127.0.0.1:8702-7) [2ae087bd] VDS 90128077-83e6-4de8-9507-5f84e162d7af was added to the Resource Manager >2014-10-01 16:07:58,332 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (ajp-/127.0.0.1:8702-7) [2ae087bd] FINISH, AddVdsVDSCommand, log id: 4e152126 >2014-10-01 16:07:58,338 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [2ae087bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-8.rhev.lab.eng.brq.redhat.com. >2014-10-01 16:07:58,346 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [2ae087bd] Correlation ID: 16a6e4, Call Stack: null, Custom Event ID: -1, Message: Host slot-8.rhev.lab.eng.brq.redhat.com was added by Non interactive user. >2014-10-01 16:07:58,346 INFO [org.ovirt.engine.core.bll.RegisterVdsQuery] (ajp-/127.0.0.1:8702-7) [2ae087bd] RegisterVdsQuery::Register - Registered a new VDS pending approval - Name: slot-8.rhev.lab.eng.brq.redhat.com, Hostname: 10.34.63.138, UniqueID: 4C4C4544-0052-4C10-8058-B3C04F43354A >2014-10-01 16:07:58,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-7) [2ae087bd] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Host slot-8.rhev.lab.eng.brq.redhat.com registered. >2014-10-01 16:08:29,450 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:08:29,450 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:08:29,450 INFO [org.ovirt.engine.core.bll.UpdateVdsCommand] (ajp-/127.0.0.1:8702-6) [1b6a3faf] Running command: UpdateVdsCommand internal: false. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:08:29,455 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:08:29,455 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-6) Unable to get value of property: vdsName for class org.ovirt.engine.core.common.businessentities.VdsStatic >2014-10-01 16:08:29,461 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [1b6a3faf] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-8.rhev.lab.eng.brq.redhat.com. >2014-10-01 16:08:29,467 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [1b6a3faf] Correlation ID: 1b6a3faf, Call Stack: null, Custom Event ID: -1, Message: Host slot-8.rhev.lab.eng.brq.redhat.com configuration was updated by admin. >2014-10-01 16:08:29,926 INFO [org.ovirt.engine.core.bll.ApproveVdsCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] Running command: ApproveVdsCommand internal: false. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:08:29,926 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] Before Installation host 90128077-83e6-4de8-9507-5f84e162d7af, slot-8.rhev.lab.eng.brq.redhat.com >2014-10-01 16:08:29,941 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] START, SetVdsStatusVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, status=Installing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 11fb71e4 >2014-10-01 16:08:29,950 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] FINISH, SetVdsStatusVDSCommand, log id: 11fb71e4 >2014-10-01 16:08:30,177 INFO [org.ovirt.engine.core.bll.InstallerMessages] (org.ovirt.thread.pool-4-thread-48) [38d158f] Installation 10.34.63.138: Connected to host 10.34.63.138 with SSH key fingerprint: bb:3f:3f:a0:30:ca:e7:02:7e:de:f5:a0:22:b8:a5:1a >2014-10-01 16:08:30,183 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [38d158f] Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Connected to host 10.34.63.138 with SSH key fingerprint: bb:3f:3f:a0:30:ca:e7:02:7e:de:f5:a0:22:b8:a5:1a. >2014-10-01 16:08:30,222 INFO [org.ovirt.engine.core.bll.VdsDeploy] (org.ovirt.thread.pool-4-thread-48) [38d158f] Installation of 10.34.63.138. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-10-01 16:08:30,233 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (org.ovirt.thread.pool-4-thread-48) SSH execute root@10.34.63.138 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-10-01 16:08:31,349 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Initializing >2014-10-01 16:08:31,356 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Initializing. >2014-10-01 16:08:31,378 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-75) Initializing Host: slot-8.rhev.lab.eng.brq.redhat.com >2014-10-01 16:08:31,380 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Environment setup >2014-10-01 16:08:31,386 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Environment setup. >2014-10-01 16:08:31,396 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Environment packages setup >2014-10-01 16:08:31,401 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Environment packages setup. >2014-10-01 16:08:31,401 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Programs detection >2014-10-01 16:08:31,406 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Programs detection. >2014-10-01 16:08:31,408 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Environment customization >2014-10-01 16:08:31,414 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Environment customization. >2014-10-01 16:08:31,459 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Host is hypervisor >2014-10-01 16:08:31,467 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Host is hypervisor. >2014-10-01 16:08:31,475 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Logs at host located at: '/tmp/ovirt-host-deploy-20141001140830-e1j6yp.log' >2014-10-01 16:08:31,481 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Logs at host located at: '/tmp/ovirt-host-deploy-20141001140830-e1j6yp.log'. >2014-10-01 16:08:31,514 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.34.63.138 reports unique id 4C4C4544-0052-4C10-8058-B3C04F43354A >2014-10-01 16:08:31,539 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 4C4C4544-0052-4C10-8058-B3C04F43354A to Host 10.34.63.138 >2014-10-01 16:08:31,611 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Setup validation >2014-10-01 16:08:31,617 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Setup validation. >2014-10-01 16:08:31,755 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Hardware supports virtualization >2014-10-01 16:08:31,762 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Hardware supports virtualization. >2014-10-01 16:08:31,762 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Transaction setup >2014-10-01 16:08:31,768 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Transaction setup. >2014-10-01 16:08:31,768 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Misc configuration >2014-10-01 16:08:31,773 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-10-01 16:08:31,773 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Package installation >2014-10-01 16:08:31,779 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Package installation. >2014-10-01 16:08:39,473 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Misc configuration >2014-10-01 16:08:39,479 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Misc configuration. >2014-10-01 16:08:39,815 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Enrolling certificate >2014-10-01 16:08:39,823 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Enrolling certificate. >2014-10-01 16:08:41,005 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Transaction commit >2014-10-01 16:08:41,012 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Transaction commit. >2014-10-01 16:08:41,012 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stage: Closing up >2014-10-01 16:08:41,019 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stage: Closing up. >2014-10-01 16:08:47,235 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Stopping libvirtd >2014-10-01 16:08:47,241 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Stopping libvirtd. >2014-10-01 16:08:47,918 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Starting vdsm >2014-10-01 16:08:47,924 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Starting vdsm. >2014-10-01 16:09:05,511 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.34.63.138: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001160905-10.34.63.138-38d158f.log' >2014-10-01 16:09:05,517 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 38d158f, Call Stack: null, Custom Event ID: -1, Message: Installing Host slot-8.rhev.lab.eng.brq.redhat.com. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141001160905-10.34.63.138-38d158f.log'. >2014-10-01 16:09:05,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:09:05,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] Command PollVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:09:06,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] org.ovirt.engine.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:09:06,386 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] Command PollVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af) execution failed. Exception: VDSRecoveringException: Recovering from crash or Initializing >2014-10-01 16:09:06,892 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (org.ovirt.thread.pool-4-thread-48) [38d158f] Engine managed to communicate with VDSM agent on host slot-8.rhev.lab.eng.brq.redhat.com >2014-10-01 16:09:07,107 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] START, SetVdsStatusVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, status=Initializing, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 4c92c3e4 >2014-10-01 16:09:07,111 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] FINISH, SetVdsStatusVDSCommand, log id: 4c92c3e4 >2014-10-01 16:09:07,111 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] After Installation host slot-8.rhev.lab.eng.brq.redhat.com, oVirtNode >2014-10-01 16:09:07,116 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] START, SetVdsStatusVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 326962e0 >2014-10-01 16:09:07,119 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (org.ovirt.thread.pool-4-thread-48) [38d158f] FINISH, SetVdsStatusVDSCommand, log id: 326962e0 >2014-10-01 16:09:07,125 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-48) [38d158f] Correlation ID: 38d158f, Job ID: 6545b62a-3706-4514-b414-26a8aaac9f48, Call Stack: null, Custom Event ID: -1, Message: Host slot-8.rhev.lab.eng.brq.redhat.com was successfully approved by user admin. >2014-10-01 16:09:07,484 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GetHardwareInfoVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vds=Host[slot-8.rhev.lab.eng.brq.redhat.com,90128077-83e6-4de8-9507-5f84e162d7af]), log id: 31ff5f60 >2014-10-01 16:09:07,600 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GetHardwareInfoVDSCommand, log id: 31ff5f60 >2014-10-01 16:09:07,621 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-83) [44315c83] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:09:07,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) [44315c83] START, GetHardwareInfoVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vds=Host[slot-8.rhev.lab.eng.brq.redhat.com,90128077-83e6-4de8-9507-5f84e162d7af]), log id: 2b3e404c >2014-10-01 16:09:07,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) [44315c83] FINISH, GetHardwareInfoVDSCommand, log id: 2b3e404c >2014-10-01 16:09:07,759 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [44315c83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host slot-8.rhev.lab.eng.brq.redhat.com. >2014-10-01 16:09:07,804 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-83) [31febf30] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 16:09:07,809 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 00000002-0002-0002-0002-000000000135 Type: StoragePool >2014-10-01 16:09:07,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] START, ConnectStorageServerVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, storagePoolId = 00000002-0002-0002-0002-000000000135, storageType = NFS, connectionList = [{ id: 191ca4e4-ef79-4b0a-a943-391a8fc9e05d, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n3, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: d335368a-a602-4063-8d48-870b83b2f0c2, connection: str-01.rhev.lab.eng.brq.redhat.com:/mnt/export/nfs/lv3/pbenas/n2, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a6d532c >2014-10-01 16:09:08,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] FINISH, ConnectStorageServerVDSCommand, return: {191ca4e4-ef79-4b0a-a943-391a8fc9e05d=0, d335368a-a602-4063-8d48-870b83b2f0c2=0}, log id: 7a6d532c >2014-10-01 16:09:08,459 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] Host slot-8.rhev.lab.eng.brq.redhat.com storage connection was succeeded >2014-10-01 16:09:08,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-44) START, ConnectStoragePoolVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, storagePoolId = 00000002-0002-0002-0002-000000000135, vds_spm_id = 4, masterDomainId = dd3c814d-9d43-46ff-8708-52dc8b452a97, masterVersion = 3), log id: 5dd8fb39 >2014-10-01 16:09:09,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (org.ovirt.thread.pool-4-thread-44) FINISH, ConnectStoragePoolVDSCommand, log id: 5dd8fb39 >2014-10-01 16:09:09,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] START, SetMOMPolicyParametersVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af), log id: 46d8fa80 >2014-10-01 16:09:10,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetMOMPolicyParametersVDSCommand] (DefaultQuartzScheduler_Worker-83) [7e172741] FINISH, SetMOMPolicyParametersVDSCommand, log id: 46d8fa80 >2014-10-01 16:09:10,113 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [7e172741] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Failed to verify Power Management configuration for Host slot-8.rhev.lab.eng.brq.redhat.com. >2014-10-01 16:09:10,121 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-83) [4aacaafb] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:09:10,126 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-83) [24339032] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 90128077-83e6-4de8-9507-5f84e162d7af Type: VDS >2014-10-01 16:09:53,957 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [6c823fd8] Lock Acquired to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-10-01 16:09:54,024 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [6c823fd8] Running command: UpdateVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM, ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:09:54,046 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) [6c823fd8] Correlation ID: 6c823fd8, Job ID: 926c691c-7433-49c5-ab6f-a1cecbb09131, Call Stack: null, Custom Event ID: -1, Message: VM dalsi configuration was updated by admin. >2014-10-01 16:09:54,052 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [6c823fd8] Lock freed to object EngineLock [exclusiveLocks= key: dalsi value: VM_NAME >, sharedLocks= ] >2014-10-01 16:09:58,224 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-5) [7c098c7] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 16:09:58,244 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [7c098c7] START, IsVmDuringInitiatingVDSCommand( vmId = a50e8ea6-38ce-4875-ae04-b0f4aff74534), log id: 5d112434 >2014-10-01 16:09:58,244 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) [7c098c7] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 5d112434 >2014-10-01 16:09:58,281 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] Running command: RunVmCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:09:58,316 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] START, CreateVmVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 5c085810 >2014-10-01 16:09:58,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] START, CreateVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, vm=VM [dalsi]), log id: 286c78 >2014-10-01 16:09:58,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=1024,kvmEnable=true,smp=1,vmType=kvm,emulatedMachine=rhel6.5.0,keyboardLayout=en-us,memGuaranteedSize=1024,nice=0,display=qxl,smartcardEnable=false,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,maxVCpus=16,timeOffset=0,transparentHugePages=true,vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534,devices=[{address={bus=0x00, domain=0x0000, slot=0x02, type=pci, function=0x0}, specParams={vram=32768, heads=1}, device=qxl, type=video, deviceId=b6ef70ed-b5fe-438d-a047-ca774d97b650}, {shared=false, iface=ide, index=2, address={unit=0, bus=1, target=0, controller=0, type=drive}, specParams={path=}, path=, device=cdrom, type=disk, readonly=true, deviceId=6e39ef6c-7c3e-4b35-8894-344fe08abdc4}, {shared=false, index=0, volumeID=59b771e5-a0d8-40ab-ba94-c10e44a82eec, propagateErrors=off, format=raw, type=disk, iface=virtio, bootOrder=2, address={bus=0x00, domain=0x0000, slot=0x06, type=pci, function=0x0}, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, imageID=b4b4d9d0-e202-4a50-a3aa-520aed2fd057, specParams={}, optional=false, device=disk, poolID=00000002-0002-0002-0002-000000000135, readonly=false, deviceId=b4b4d9d0-e202-4a50-a3aa-520aed2fd057}, {shared=false, volumeID=9fc7a631-0a2d-4000-96d7-7d8080b8b091, iface=virtio, imageID=dfb71e18-fd2e-4957-9438-0d21d0d37fab, domainID=dd3c814d-9d43-46ff-8708-52dc8b452a97, address={bus=0x00, domain=0x0000, slot=0x08, type=pci, function=0x0}, specParams={}, optional=false, propagateErrors=off, device=disk, poolID=00000002-0002-0002-0002-000000000135, format=raw, type=disk, readonly=false, deviceId=dfb71e18-fd2e-4957-9438-0d21d0d37fab}, {nicModel=pv, bootOrder=1, address={bus=0x00, domain=0x0000, slot=0x03, type=pci, function=0x0}, specParams={outbound={}, inbound={}}, macAddr=00:1a:4a:af:6b:0e, device=bridge, linkActive=true, type=interface, filter=vdsm-no-mac-spoofing, network=rhevm, deviceId=c294099f-e42c-4d67-b0a8-a168dd4db5fd}, {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=90304153-6961-466f-8614-e91f7a9aaa78}, {index=0, model=virtio-scsi, address={bus=0x00, domain=0x0000, slot=0x04, type=pci, function=0x0}, specParams={}, device=scsi, type=controller, deviceId=4827014f-a8bd-4905-8b89-dd04b3462ed7}],acpiEnable=true,vmName=dalsi,cpuType=Westmere,custom={device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223cdevice_dbfeba13-cd20-46a3-ba12-f3d669a836ee=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=dbfeba13-cd20-46a3-ba12-f3d669a836ee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=5c24536e-f0d2-4c1c-b105-82048377178d, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9628c7c2-de1b-4cf1-b514-218173837453, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=ef122ad6-7138-4767-93e0-3e0fdce3223c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=b5ddb46c-653c-48e7-9012-fd63459264a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}} >2014-10-01 16:09:58,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] FINISH, CreateVDSCommand, log id: 286c78 >2014-10-01 16:09:58,437 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5c085810 >2014-10-01 16:09:58,438 INFO [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-21) [7c098c7] Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 16:09:58,442 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-21) [7c098c7] Correlation ID: 7c098c7, Job ID: 1a096862-5f40-43db-bfc4-c9d934b73bb6, Call Stack: null, Custom Event ID: -1, Message: VM dalsi was started by admin (Host: slot-8.rhev.lab.eng.brq.redhat.com). >2014-10-01 16:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) Autorecovering 1 hosts >2014-10-01 16:10:00,017 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-32) Autorecovering hosts id: 1958d5db-c7d0-4c26-a04b-f194ae7620f7, name : Host3-polo >2014-10-01 16:10:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Lock Acquired to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:10:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:10:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Before acquiring lock in order to prevent monitoring for host Host3-polo from data-center Default_foobar >2014-10-01 16:10:00,019 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Lock acquired, from now a monitoring of host will be skipped for host Host3-polo from data-center Default_foobar >2014-10-01 16:10:00,033 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=Unassigned, nonOperationalReason=NONE, stopSpmFailureLogged=false), log id: 322ea1ea >2014-10-01 16:10:00,037 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] FINISH, SetVdsStatusVDSCommand, log id: 322ea1ea >2014-10-01 16:10:00,062 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Activate finished. Lock released. Monitoring can run now for host Host3-polo from data-center Default_foobar >2014-10-01 16:10:00,063 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-32) [774544ec] Lock freed to object EngineLock [exclusiveLocks= key: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 value: VDS >, sharedLocks= ] >2014-10-01 16:10:00,714 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GetHardwareInfoVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, vds=Host[Host3-polo,1958d5db-c7d0-4c26-a04b-f194ae7620f7]), log id: 1ba4b5b3 >2014-10-01 16:10:00,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GetHardwareInfoVDSCommand, log id: 1ba4b5b3 >2014-10-01 16:10:00,780 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (DefaultQuartzScheduler_Worker-13) [7d4a37b0] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:10:00,796 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-13) [1dd787d4] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:10:00,798 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [1dd787d4] START, SetVdsStatusVDSCommand(HostName = Host3-polo, HostId = 1958d5db-c7d0-4c26-a04b-f194ae7620f7, status=NonOperational, nonOperationalReason=CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER, stopSpmFailureLogged=false), log id: 6938317f >2014-10-01 16:10:00,802 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [1dd787d4] FINISH, SetVdsStatusVDSCommand, log id: 6938317f >2014-10-01 16:10:00,812 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) [1dd787d4] Correlation ID: 1dd787d4, Job ID: f6c2494b-cc70-49e8-9e74-d08d6865816a, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state. >2014-10-01 16:10:00,819 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) [1dd787d4] Correlation ID: 7d4a37b0, Call Stack: null, Custom Event ID: -1, Message: Host Host3-polo moved to Non-Operational state as host does not meet the cluster's minimum CPU level. Missing CPU features : aes, model_Westmere >2014-10-01 16:10:00,826 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) [1dd787d4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host Host3-polo. >2014-10-01 16:10:00,841 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-13) [7ea1c77d] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1958d5db-c7d0-4c26-a04b-f194ae7620f7 Type: VDS >2014-10-01 16:10:00,843 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-13) [7ea1c77d] Host 1958d5db-c7d0-4c26-a04b-f194ae7620f7 : Host3-polo is already in NonOperational status for reason CPU_TYPE_INCOMPATIBLE_WITH_CLUSTER. SetNonOperationalVds command is skipped. >2014-10-01 16:10:01,604 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-53) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from WaitForLaunch --> PoweringUp >2014-10-01 16:10:11,615 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-3) [32d86b44] Running command: SetVmTicketCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:10:11,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [32d86b44] START, SetVmTicketVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, ticket=14pOKun9h+DT, validTime=120,m userName=admin, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 17bf2f42 >2014-10-01 16:10:11,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-3) [32d86b44] FINISH, SetVmTicketVDSCommand, log id: 17bf2f42 >2014-10-01 16:10:11,662 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [32d86b44] Correlation ID: 32d86b44, Call Stack: null, Custom Event ID: -1, Message: user admin initiated console session for VM dalsi >2014-10-01 16:10:25,877 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-49) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal is connected to VM dalsi. >2014-10-01 16:10:59,211 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-71) [59daf294] VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from PoweringUp --> Up >2014-10-01 16:10:59,222 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-71) [59daf294] Correlation ID: 7c098c7, Job ID: 1a096862-5f40-43db-bfc4-c9d934b73bb6, Call Stack: null, Custom Event ID: -1, Message: VM dalsi started on Host slot-8.rhev.lab.eng.brq.redhat.com >2014-10-01 16:11:14,039 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-5) [535148df] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 16:11:14,090 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:11:14,107 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] START, MigrateVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.63.138, dstVdsId=6cad778e-9f75-43c2-bdd5-5d25687adc9a, dstHost=10.34.62.205:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 24622d31 >2014-10-01 16:11:14,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] VdsBroker::migrate::Entered (vm_guid=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.63.138, dstHost=10.34.62.205:54321, method=online >2014-10-01 16:11:14,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] START, MigrateBrokerVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.63.138, dstVdsId=6cad778e-9f75-43c2-bdd5-5d25687adc9a, dstHost=10.34.62.205:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 308ea8cd >2014-10-01 16:11:14,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] FINISH, MigrateBrokerVDSCommand, log id: 308ea8cd >2014-10-01 16:11:14,124 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-29) [535148df] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 24622d31 >2014-10-01 16:11:14,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-29) [535148df] Correlation ID: 535148df, Job ID: 3af4dde2-8f56-4010-b666-eeb91b9bdb50, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: dalsi, Source: slot-8.rhev.lab.eng.brq.redhat.com, Destination: RHEVH, User: admin). >2014-10-01 16:11:17,301 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-83) [24339032] RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds RHEVH ignoring it in the refresh until migration is done >2014-10-01 16:11:20,324 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-9) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds RHEVH ignoring it in the refresh until migration is done >2014-10-01 16:11:20,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) START, FullListVdsCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vds=Host[slot-8.rhev.lab.eng.brq.redhat.com,90128077-83e6-4de8-9507-5f84e162d7af], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 448715d2 >2014-10-01 16:11:20,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-97) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, keyboardLayout=en-us, displayIp=0, pauseCode=NOERR, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223cdevice_dbfeba13-cd20-46a3-ba12-f3d669a836ee=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=dbfeba13-cd20-46a3-ba12-f3d669a836ee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=5c24536e-f0d2-4c1c-b105-82048377178d, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9628c7c2-de1b-4cf1-b514-218173837453, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=ef122ad6-7138-4767-93e0-3e0fdce3223c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=b5ddb46c-653c-48e7-9012-fd63459264a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, displayPort=5900, smp=1, emulatedMachine=rhel6.5.0, status=Migration Source, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=2769, smartcardEnable=false, smpCoresPerSocket=1, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxVCpus=16, clientIp=10.34.131.3, _migrationParams={dstparams=, method=online, dst=10.34.62.205:54321, dstqemu=, mode=remote}, devices=[Ljava.lang.Object;@a9b124, vmName=dalsi, cpuType=Westmere}], log id: 448715d2 >2014-10-01 16:11:23,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] START, FullListVdsCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vds=Host[RHEVH,6cad778e-9f75-43c2-bdd5-5d25687adc9a], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: 55d9eb06 >2014-10-01 16:11:23,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223cdevice_dbfeba13-cd20-46a3-ba12-f3d669a836ee=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=dbfeba13-cd20-46a3-ba12-f3d669a836ee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=5c24536e-f0d2-4c1c-b105-82048377178d, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9628c7c2-de1b-4cf1-b514-218173837453, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=ef122ad6-7138-4767-93e0-3e0fdce3223c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=b5ddb46c-653c-48e7-9012-fd63459264a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, status=Up, emulatedMachine=rhel6.5.0, vmType=kvm, memGuaranteedSize=1024, display=qxl, pid=1076, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@55d502f2, vmName=dalsi, cpuType=Westmere}], log id: 55d9eb06 >2014-10-01 16:11:23,391 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Correlation ID: 535148df, Job ID: 3af4dde2-8f56-4010-b666-eeb91b9bdb50, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dalsi, Source: slot-8.rhev.lab.eng.brq.redhat.com, Destination: RHEVH, Duration: 9 sec). >2014-10-01 16:11:23,394 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (DefaultQuartzScheduler_Worker-18) [2b83aa32] Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 16:11:23,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) START, DestroyVDSCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: f95752d >2014-10-01 16:11:24,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, DestroyVDSCommand, log id: f95752d >2014-10-01 16:11:24,094 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-67) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 status = Down on vds slot-8.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-10-01 16:12:06,554 WARN [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil] (org.ovirt.thread.pool-4-thread-45) Executing a command: java.util.concurrent.FutureTask , but note that there are 1 tasks in the queue. >2014-10-01 16:12:11,499 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (ajp-/127.0.0.1:8702-11) [43abc309] Lock Acquired to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ] >2014-10-01 16:12:11,591 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] Running command: MigrateVmToServerCommand internal: false. Entities affected : ID: a50e8ea6-38ce-4875-ae04-b0f4aff74534 Type: VM >2014-10-01 16:12:11,654 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] START, MigrateVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstVdsId=90128077-83e6-4de8-9507-5f84e162d7af, dstHost=10.34.63.138:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: f9ec8f6 >2014-10-01 16:12:11,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] VdsBroker::migrate::Entered (vm_guid=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstHost=10.34.63.138:54321, method=online >2014-10-01 16:12:11,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] START, MigrateBrokerVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, srcHost=10.34.62.205, dstVdsId=90128077-83e6-4de8-9507-5f84e162d7af, dstHost=10.34.63.138:54321, migrationMethod=ONLINE, tunnelMigration=false, migrationDowntime=0), log id: 5a908b6f >2014-10-01 16:12:11,667 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] FINISH, MigrateBrokerVDSCommand, log id: 5a908b6f >2014-10-01 16:12:11,672 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (org.ovirt.thread.pool-4-thread-35) [43abc309] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: f9ec8f6 >2014-10-01 16:12:11,678 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-35) [43abc309] Correlation ID: 43abc309, Job ID: fbb78be7-772c-433d-a757-f2313d009743, Call Stack: null, Custom Event ID: -1, Message: Migration started (VM: dalsi, Source: RHEVH, Destination: slot-8.rhev.lab.eng.brq.redhat.com, User: admin). >2014-10-01 16:12:12,587 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-48) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds slot-8.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-10-01 16:12:15,610 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds slot-8.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-10-01 16:12:18,632 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-73) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds slot-8.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-10-01 16:12:21,737 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-89) RefreshVmList vm id a50e8ea6-38ce-4875-ae04-b0f4aff74534 is migrating to vds slot-8.rhev.lab.eng.brq.redhat.com ignoring it in the refresh until migration is done >2014-10-01 16:12:23,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-11) START, DestroyVDSCommand(HostName = RHEVH, HostId = 6cad778e-9f75-43c2-bdd5-5d25687adc9a, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, force=false, secondsToWait=0, gracefully=false), log id: 4f93cb66 >2014-10-01 16:12:24,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, DestroyVDSCommand, log id: 4f93cb66 >2014-10-01 16:12:24,163 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-11) Handing over VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 to Host 90128077-83e6-4de8-9507-5f84e162d7af. Setting VM to status MigratingTo >2014-10-01 16:12:24,163 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-11) VM dalsi (a50e8ea6-38ce-4875-ae04-b0f4aff74534) is running in db and not running in VDS RHEVH >2014-10-01 16:12:24,777 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-98) VM dalsi a50e8ea6-38ce-4875-ae04-b0f4aff74534 moved from MigratingTo --> Up >2014-10-01 16:12:24,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) START, FullListVdsCommand(HostName = slot-8.rhev.lab.eng.brq.redhat.com, HostId = 90128077-83e6-4de8-9507-5f84e162d7af, vds=Host[slot-8.rhev.lab.eng.brq.redhat.com,90128077-83e6-4de8-9507-5f84e162d7af], vmIds=[a50e8ea6-38ce-4875-ae04-b0f4aff74534]), log id: f0d3fe4 >2014-10-01 16:12:24,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (DefaultQuartzScheduler_Worker-98) FINISH, FullListVdsCommand, return: [{displaySecurePort=5901, kvmEnable=true, nicModel=rtl8139,pv, afterMigrationStatus=, keyboardLayout=en-us, displayIp=0, nice=0, timeOffset=0, transparentHugePages=true, vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, acpiEnable=true, custom={device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223cdevice_dbfeba13-cd20-46a3-ba12-f3d669a836ee=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=dbfeba13-cd20-46a3-ba12-f3d669a836ee, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178d=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=5c24536e-f0d2-4c1c-b105-82048377178d, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=9628c7c2-de1b-4cf1-b514-218173837453, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7device_9628c7c2-de1b-4cf1-b514-218173837453device_ef122ad6-7138-4767-93e0-3e0fdce3223c=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=ef122ad6-7138-4767-93e0-3e0fdce3223c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}, device_5c24536e-f0d2-4c1c-b105-82048377178ddevice_b5ddb46c-653c-48e7-9012-fd63459264a7=VmDevice {vmId=a50e8ea6-38ce-4875-ae04-b0f4aff74534, deviceId=b5ddb46c-653c-48e7-9012-fd63459264a7, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}}, spiceSslCipherSuite=DEFAULT, memSize=1024, smp=1, displayPort=5900, status=Up, vmType=kvm, emulatedMachine=rhel6.5.0, memGuaranteedSize=1024, display=qxl, pid=3286, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, smpCoresPerSocket=1, maxVCpus=16, clientIp=10.34.131.3, devices=[Ljava.lang.Object;@2edd9974, vmName=dalsi, cpuType=Westmere}], log id: f0d3fe4 >2014-10-01 16:12:24,819 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) Correlation ID: 43abc309, Job ID: fbb78be7-772c-433d-a757-f2313d009743, Call Stack: null, Custom Event ID: -1, Message: Migration completed (VM: dalsi, Source: RHEVH, Destination: slot-8.rhev.lab.eng.brq.redhat.com, Duration: 13 sec). >2014-10-01 16:12:24,822 INFO [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (DefaultQuartzScheduler_Worker-98) Lock freed to object EngineLock [exclusiveLocks= key: a50e8ea6-38ce-4875-ae04-b0f4aff74534 value: VM >, sharedLocks= ]
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1148470
:
943068
| 943071