Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 668063 Details for
Bug 889797
Error "MAC address already in use" if adding network fails for same reason when using specific MAC address
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine.log
engine.dupmac_ui.log (text/x-log), 2.60 MB, created by
Meni Yakove
on 2012-12-23 15:47:14 UTC
(
hide
)
Description:
engine.log
Filename:
MIME Type:
Creator:
Meni Yakove
Created:
2012-12-23 15:47:14 UTC
Size:
2.60 MB
patch
obsolete
>2012-12-22 23:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts >2012-12-22 23:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering 0 hosts >2012-12-22 23:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts done >2012-12-22 23:20:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering storage domains is disabled, skipping >2012-12-22 23:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts >2012-12-22 23:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering 0 hosts >2012-12-22 23:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Checking autorecoverable hosts done >2012-12-22 23:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-32) Autorecovering storage domains is disabled, skipping >2012-12-22 23:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [2ad05129] Checking autorecoverable hosts >2012-12-22 23:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [2ad05129] Autorecovering 0 hosts >2012-12-22 23:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [2ad05129] Checking autorecoverable hosts done >2012-12-22 23:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-40) [2ad05129] Autorecovering storage domains is disabled, skipping >2012-12-22 23:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-12-22 23:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-12-22 23:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-12-22 23:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering storage domains is disabled, skipping >2012-12-22 23:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts >2012-12-22 23:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering 0 hosts >2012-12-22 23:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts done >2012-12-22 23:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering storage domains is disabled, skipping >2012-12-22 23:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-12-22 23:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-12-22 23:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-12-22 23:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains is disabled, skipping >2012-12-22 23:47:45,186 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-33) DbUserCacheManager::refreshAllUserData() - entered >2012-12-22 23:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-12-22 23:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-12-22 23:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-12-22 23:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains is disabled, skipping >2012-12-22 23:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts >2012-12-22 23:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering 0 hosts >2012-12-22 23:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts done >2012-12-22 23:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering storage domains is disabled, skipping >2012-12-23 00:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-12-23 00:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-12-23 00:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-12-23 00:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering storage domains is disabled, skipping >2012-12-23 00:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts >2012-12-23 00:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering 0 hosts >2012-12-23 00:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts done >2012-12-23 00:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering storage domains is disabled, skipping >2012-12-23 00:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-12-23 00:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-12-23 00:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-12-23 00:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering storage domains is disabled, skipping >2012-12-23 00:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-12-23 00:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-12-23 00:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-12-23 00:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains is disabled, skipping >2012-12-23 00:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-12-23 00:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-12-23 00:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-12-23 00:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering storage domains is disabled, skipping >2012-12-23 00:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) [58b180ad] Checking autorecoverable hosts >2012-12-23 00:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) [58b180ad] Autorecovering 0 hosts >2012-12-23 00:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) [58b180ad] Checking autorecoverable hosts done >2012-12-23 00:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-19) [58b180ad] Autorecovering storage domains is disabled, skipping >2012-12-23 00:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts >2012-12-23 00:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering 0 hosts >2012-12-23 00:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Checking autorecoverable hosts done >2012-12-23 00:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) Autorecovering storage domains is disabled, skipping >2012-12-23 00:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts >2012-12-23 00:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering 0 hosts >2012-12-23 00:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Checking autorecoverable hosts done >2012-12-23 00:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) Autorecovering storage domains is disabled, skipping >2012-12-23 00:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-12-23 00:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-12-23 00:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-12-23 00:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering storage domains is disabled, skipping >2012-12-23 00:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Checking autorecoverable hosts >2012-12-23 00:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Autorecovering 0 hosts >2012-12-23 00:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Checking autorecoverable hosts done >2012-12-23 00:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Autorecovering storage domains is disabled, skipping >2012-12-23 00:47:45,189 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-90) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 00:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Checking autorecoverable hosts >2012-12-23 00:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Autorecovering 0 hosts >2012-12-23 00:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Checking autorecoverable hosts done >2012-12-23 00:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Autorecovering storage domains is disabled, skipping >2012-12-23 00:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-12-23 00:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-12-23 00:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-12-23 00:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering storage domains is disabled, skipping >2012-12-23 01:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-12-23 01:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-12-23 01:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-12-23 01:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering storage domains is disabled, skipping >2012-12-23 01:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-12-23 01:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-12-23 01:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-12-23 01:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains is disabled, skipping >2012-12-23 01:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-12-23 01:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-12-23 01:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-12-23 01:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering storage domains is disabled, skipping >2012-12-23 01:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-12-23 01:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-12-23 01:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-12-23 01:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering storage domains is disabled, skipping >2012-12-23 01:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-12-23 01:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-12-23 01:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-12-23 01:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains is disabled, skipping >2012-12-23 01:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts >2012-12-23 01:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering 0 hosts >2012-12-23 01:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Checking autorecoverable hosts done >2012-12-23 01:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-85) Autorecovering storage domains is disabled, skipping >2012-12-23 01:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-12-23 01:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-12-23 01:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-12-23 01:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering storage domains is disabled, skipping >2012-12-23 01:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts >2012-12-23 01:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 hosts >2012-12-23 01:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts done >2012-12-23 01:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering storage domains is disabled, skipping >2012-12-23 01:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-12-23 01:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-12-23 01:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-12-23 01:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering storage domains is disabled, skipping >2012-12-23 01:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-12-23 01:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-12-23 01:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-12-23 01:45:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains is disabled, skipping >2012-12-23 01:47:45,191 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-49) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 01:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Checking autorecoverable hosts >2012-12-23 01:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Autorecovering 0 hosts >2012-12-23 01:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Checking autorecoverable hosts done >2012-12-23 01:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Autorecovering storage domains is disabled, skipping >2012-12-23 01:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [1e862a5d] Checking autorecoverable hosts >2012-12-23 01:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [1e862a5d] Autorecovering 0 hosts >2012-12-23 01:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [1e862a5d] Checking autorecoverable hosts done >2012-12-23 01:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [1e862a5d] Autorecovering storage domains is disabled, skipping >2012-12-23 02:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-12-23 02:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-12-23 02:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-12-23 02:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering storage domains is disabled, skipping >2012-12-23 02:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-12-23 02:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-12-23 02:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-12-23 02:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains is disabled, skipping >2012-12-23 02:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-12-23 02:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-12-23 02:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-12-23 02:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering storage domains is disabled, skipping >2012-12-23 02:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts >2012-12-23 02:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering 0 hosts >2012-12-23 02:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts done >2012-12-23 02:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering storage domains is disabled, skipping >2012-12-23 02:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts >2012-12-23 02:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering 0 hosts >2012-12-23 02:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Checking autorecoverable hosts done >2012-12-23 02:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-80) Autorecovering storage domains is disabled, skipping >2012-12-23 02:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-12-23 02:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-12-23 02:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-12-23 02:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering storage domains is disabled, skipping >2012-12-23 02:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-12-23 02:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-12-23 02:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-12-23 02:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains is disabled, skipping >2012-12-23 02:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-12-23 02:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-12-23 02:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-12-23 02:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering storage domains is disabled, skipping >2012-12-23 02:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts >2012-12-23 02:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 hosts >2012-12-23 02:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts done >2012-12-23 02:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering storage domains is disabled, skipping >2012-12-23 02:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts >2012-12-23 02:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering 0 hosts >2012-12-23 02:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Checking autorecoverable hosts done >2012-12-23 02:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-74) Autorecovering storage domains is disabled, skipping >2012-12-23 02:47:45,204 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-70) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 02:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts >2012-12-23 02:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering 0 hosts >2012-12-23 02:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Checking autorecoverable hosts done >2012-12-23 02:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) Autorecovering storage domains is disabled, skipping >2012-12-23 02:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts >2012-12-23 02:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 hosts >2012-12-23 02:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts done >2012-12-23 02:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering storage domains is disabled, skipping >2012-12-23 03:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts >2012-12-23 03:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 hosts >2012-12-23 03:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts done >2012-12-23 03:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering storage domains is disabled, skipping >2012-12-23 03:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-12-23 03:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-12-23 03:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-12-23 03:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering storage domains is disabled, skipping >2012-12-23 03:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-12-23 03:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-12-23 03:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-12-23 03:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering storage domains is disabled, skipping >2012-12-23 03:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts >2012-12-23 03:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering 0 hosts >2012-12-23 03:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Checking autorecoverable hosts done >2012-12-23 03:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-97) Autorecovering storage domains is disabled, skipping >2012-12-23 03:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts >2012-12-23 03:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering 0 hosts >2012-12-23 03:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts done >2012-12-23 03:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering storage domains is disabled, skipping >2012-12-23 03:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-12-23 03:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-12-23 03:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-12-23 03:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering storage domains is disabled, skipping >2012-12-23 03:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts >2012-12-23 03:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 hosts >2012-12-23 03:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts done >2012-12-23 03:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering storage domains is disabled, skipping >2012-12-23 03:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-12-23 03:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-12-23 03:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-12-23 03:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering storage domains is disabled, skipping >2012-12-23 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (QuartzScheduler_Worker-36) AuditLogCleanupManager::deleteAgedOutAuditLogs - entered >2012-12-23 03:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts >2012-12-23 03:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering 0 hosts >2012-12-23 03:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts done >2012-12-23 03:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering storage domains is disabled, skipping >2012-12-23 03:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-12-23 03:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-12-23 03:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-12-23 03:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering storage domains is disabled, skipping >2012-12-23 03:47:45,217 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-10) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 03:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts >2012-12-23 03:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering 0 hosts >2012-12-23 03:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Checking autorecoverable hosts done >2012-12-23 03:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-84) Autorecovering storage domains is disabled, skipping >2012-12-23 03:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-12-23 03:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-12-23 03:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-12-23 03:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains is disabled, skipping >2012-12-23 04:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts >2012-12-23 04:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 hosts >2012-12-23 04:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts done >2012-12-23 04:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering storage domains is disabled, skipping >2012-12-23 04:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-12-23 04:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-12-23 04:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-12-23 04:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering storage domains is disabled, skipping >2012-12-23 04:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-12-23 04:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-12-23 04:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-12-23 04:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering storage domains is disabled, skipping >2012-12-23 04:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts >2012-12-23 04:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering 0 hosts >2012-12-23 04:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Checking autorecoverable hosts done >2012-12-23 04:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-70) Autorecovering storage domains is disabled, skipping >2012-12-23 04:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Checking autorecoverable hosts >2012-12-23 04:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Autorecovering 0 hosts >2012-12-23 04:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Checking autorecoverable hosts done >2012-12-23 04:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [3cea5d88] Autorecovering storage domains is disabled, skipping >2012-12-23 04:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts >2012-12-23 04:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering 0 hosts >2012-12-23 04:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Checking autorecoverable hosts done >2012-12-23 04:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-86) Autorecovering storage domains is disabled, skipping >2012-12-23 04:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-12-23 04:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-12-23 04:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-12-23 04:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains is disabled, skipping >2012-12-23 04:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-12-23 04:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-12-23 04:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-12-23 04:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering storage domains is disabled, skipping >2012-12-23 04:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-12-23 04:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-12-23 04:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-12-23 04:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering storage domains is disabled, skipping >2012-12-23 04:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts >2012-12-23 04:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 hosts >2012-12-23 04:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts done >2012-12-23 04:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering storage domains is disabled, skipping >2012-12-23 04:47:45,219 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-43) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 04:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-12-23 04:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-12-23 04:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-12-23 04:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering storage domains is disabled, skipping >2012-12-23 04:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts >2012-12-23 04:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering 0 hosts >2012-12-23 04:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Checking autorecoverable hosts done >2012-12-23 04:55:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) Autorecovering storage domains is disabled, skipping >2012-12-23 05:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts >2012-12-23 05:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering 0 hosts >2012-12-23 05:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Checking autorecoverable hosts done >2012-12-23 05:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-79) Autorecovering storage domains is disabled, skipping >2012-12-23 05:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts >2012-12-23 05:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering 0 hosts >2012-12-23 05:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Checking autorecoverable hosts done >2012-12-23 05:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-96) Autorecovering storage domains is disabled, skipping >2012-12-23 05:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-12-23 05:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-12-23 05:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-12-23 05:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering storage domains is disabled, skipping >2012-12-23 05:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts >2012-12-23 05:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering 0 hosts >2012-12-23 05:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Checking autorecoverable hosts done >2012-12-23 05:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-31) Autorecovering storage domains is disabled, skipping >2012-12-23 05:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts >2012-12-23 05:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering 0 hosts >2012-12-23 05:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts done >2012-12-23 05:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering storage domains is disabled, skipping >2012-12-23 05:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-12-23 05:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-12-23 05:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-12-23 05:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering storage domains is disabled, skipping >2012-12-23 05:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts >2012-12-23 05:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering 0 hosts >2012-12-23 05:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Checking autorecoverable hosts done >2012-12-23 05:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) Autorecovering storage domains is disabled, skipping >2012-12-23 05:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-12-23 05:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-12-23 05:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-12-23 05:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering storage domains is disabled, skipping >2012-12-23 05:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-12-23 05:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-12-23 05:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-12-23 05:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains is disabled, skipping >2012-12-23 05:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts >2012-12-23 05:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering 0 hosts >2012-12-23 05:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Checking autorecoverable hosts done >2012-12-23 05:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) Autorecovering storage domains is disabled, skipping >2012-12-23 05:47:45,222 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-42) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 05:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-12-23 05:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-12-23 05:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-12-23 05:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering storage domains is disabled, skipping >2012-12-23 05:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Checking autorecoverable hosts >2012-12-23 05:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Autorecovering 0 hosts >2012-12-23 05:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Checking autorecoverable hosts done >2012-12-23 05:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-28) Autorecovering storage domains is disabled, skipping >2012-12-23 06:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts >2012-12-23 06:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering 0 hosts >2012-12-23 06:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Checking autorecoverable hosts done >2012-12-23 06:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-92) Autorecovering storage domains is disabled, skipping >2012-12-23 06:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-12-23 06:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-12-23 06:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-12-23 06:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains is disabled, skipping >2012-12-23 06:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts >2012-12-23 06:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering 0 hosts >2012-12-23 06:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Checking autorecoverable hosts done >2012-12-23 06:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) Autorecovering storage domains is disabled, skipping >2012-12-23 06:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-12-23 06:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-12-23 06:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-12-23 06:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering storage domains is disabled, skipping >2012-12-23 06:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-12-23 06:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-12-23 06:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-12-23 06:20:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering storage domains is disabled, skipping >2012-12-23 06:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-12-23 06:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-12-23 06:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-12-23 06:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering storage domains is disabled, skipping >2012-12-23 06:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts >2012-12-23 06:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering 0 hosts >2012-12-23 06:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Checking autorecoverable hosts done >2012-12-23 06:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) Autorecovering storage domains is disabled, skipping >2012-12-23 06:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-12-23 06:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-12-23 06:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-12-23 06:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering storage domains is disabled, skipping >2012-12-23 06:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Checking autorecoverable hosts >2012-12-23 06:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Autorecovering 0 hosts >2012-12-23 06:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Checking autorecoverable hosts done >2012-12-23 06:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Autorecovering storage domains is disabled, skipping >2012-12-23 06:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts >2012-12-23 06:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering 0 hosts >2012-12-23 06:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Checking autorecoverable hosts done >2012-12-23 06:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-95) Autorecovering storage domains is disabled, skipping >2012-12-23 06:47:45,224 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-8) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 06:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [5daef380] Checking autorecoverable hosts >2012-12-23 06:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [5daef380] Autorecovering 0 hosts >2012-12-23 06:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [5daef380] Checking autorecoverable hosts done >2012-12-23 06:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-69) [5daef380] Autorecovering storage domains is disabled, skipping >2012-12-23 06:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-12-23 06:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-12-23 06:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-12-23 06:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains is disabled, skipping >2012-12-23 07:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-12-23 07:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-12-23 07:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-12-23 07:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering storage domains is disabled, skipping >2012-12-23 07:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-12-23 07:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-12-23 07:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-12-23 07:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains is disabled, skipping >2012-12-23 07:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Checking autorecoverable hosts >2012-12-23 07:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Autorecovering 0 hosts >2012-12-23 07:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Checking autorecoverable hosts done >2012-12-23 07:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Autorecovering storage domains is disabled, skipping >2012-12-23 07:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts >2012-12-23 07:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering 0 hosts >2012-12-23 07:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Checking autorecoverable hosts done >2012-12-23 07:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) Autorecovering storage domains is disabled, skipping >2012-12-23 07:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-12-23 07:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-12-23 07:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-12-23 07:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains is disabled, skipping >2012-12-23 07:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [3707f39] Checking autorecoverable hosts >2012-12-23 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [3707f39] Autorecovering 0 hosts >2012-12-23 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [3707f39] Checking autorecoverable hosts done >2012-12-23 07:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-83) [3707f39] Autorecovering storage domains is disabled, skipping >2012-12-23 07:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-12-23 07:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-12-23 07:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-12-23 07:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains is disabled, skipping >2012-12-23 07:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts >2012-12-23 07:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering 0 hosts >2012-12-23 07:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Checking autorecoverable hosts done >2012-12-23 07:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) Autorecovering storage domains is disabled, skipping >2012-12-23 07:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts >2012-12-23 07:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering 0 hosts >2012-12-23 07:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Checking autorecoverable hosts done >2012-12-23 07:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-16) Autorecovering storage domains is disabled, skipping >2012-12-23 07:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts >2012-12-23 07:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering 0 hosts >2012-12-23 07:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts done >2012-12-23 07:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering storage domains is disabled, skipping >2012-12-23 07:47:45,225 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-77) [45535bf3] DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 07:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts >2012-12-23 07:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering 0 hosts >2012-12-23 07:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts done >2012-12-23 07:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering storage domains is disabled, skipping >2012-12-23 07:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts >2012-12-23 07:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering 0 hosts >2012-12-23 07:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Checking autorecoverable hosts done >2012-12-23 07:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-62) Autorecovering storage domains is disabled, skipping >2012-12-23 08:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-12-23 08:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-12-23 08:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-12-23 08:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains is disabled, skipping >2012-12-23 08:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-12-23 08:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-12-23 08:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-12-23 08:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains is disabled, skipping >2012-12-23 08:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-12-23 08:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-12-23 08:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-12-23 08:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering storage domains is disabled, skipping >2012-12-23 08:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-12-23 08:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-12-23 08:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-12-23 08:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering storage domains is disabled, skipping >2012-12-23 08:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-12-23 08:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-12-23 08:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-12-23 08:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering storage domains is disabled, skipping >2012-12-23 08:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Checking autorecoverable hosts >2012-12-23 08:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Autorecovering 0 hosts >2012-12-23 08:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Checking autorecoverable hosts done >2012-12-23 08:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [2aa79518] Autorecovering storage domains is disabled, skipping >2012-12-23 08:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts >2012-12-23 08:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering 0 hosts >2012-12-23 08:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts done >2012-12-23 08:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering storage domains is disabled, skipping >2012-12-23 08:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts >2012-12-23 08:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering 0 hosts >2012-12-23 08:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Checking autorecoverable hosts done >2012-12-23 08:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-23) Autorecovering storage domains is disabled, skipping >2012-12-23 08:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-12-23 08:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-12-23 08:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-12-23 08:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering storage domains is disabled, skipping >2012-12-23 08:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts >2012-12-23 08:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering 0 hosts >2012-12-23 08:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts done >2012-12-23 08:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering storage domains is disabled, skipping >2012-12-23 08:47:45,229 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-84) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 08:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-12-23 08:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-12-23 08:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-12-23 08:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering storage domains is disabled, skipping >2012-12-23 08:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-12-23 08:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-12-23 08:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-12-23 08:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering storage domains is disabled, skipping >2012-12-23 09:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts >2012-12-23 09:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering 0 hosts >2012-12-23 09:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts done >2012-12-23 09:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering storage domains is disabled, skipping >2012-12-23 09:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts >2012-12-23 09:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering 0 hosts >2012-12-23 09:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Checking autorecoverable hosts done >2012-12-23 09:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-90) Autorecovering storage domains is disabled, skipping >2012-12-23 09:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts >2012-12-23 09:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering 0 hosts >2012-12-23 09:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Checking autorecoverable hosts done >2012-12-23 09:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-5) [3717512e] Autorecovering storage domains is disabled, skipping >2012-12-23 09:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts >2012-12-23 09:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering 0 hosts >2012-12-23 09:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Checking autorecoverable hosts done >2012-12-23 09:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-78) Autorecovering storage domains is disabled, skipping >2012-12-23 09:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts >2012-12-23 09:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering 0 hosts >2012-12-23 09:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Checking autorecoverable hosts done >2012-12-23 09:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) Autorecovering storage domains is disabled, skipping >2012-12-23 09:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Checking autorecoverable hosts >2012-12-23 09:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Autorecovering 0 hosts >2012-12-23 09:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Checking autorecoverable hosts done >2012-12-23 09:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-99) [6d05d220] Autorecovering storage domains is disabled, skipping >2012-12-23 09:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts >2012-12-23 09:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering 0 hosts >2012-12-23 09:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Checking autorecoverable hosts done >2012-12-23 09:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) Autorecovering storage domains is disabled, skipping >2012-12-23 09:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-12-23 09:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-12-23 09:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-12-23 09:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains is disabled, skipping >2012-12-23 09:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts >2012-12-23 09:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering 0 hosts >2012-12-23 09:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Checking autorecoverable hosts done >2012-12-23 09:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-94) Autorecovering storage domains is disabled, skipping >2012-12-23 09:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts >2012-12-23 09:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering 0 hosts >2012-12-23 09:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Checking autorecoverable hosts done >2012-12-23 09:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-76) [947a8e6] Autorecovering storage domains is disabled, skipping >2012-12-23 09:47:45,231 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-97) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 09:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts >2012-12-23 09:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering 0 hosts >2012-12-23 09:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Checking autorecoverable hosts done >2012-12-23 09:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-43) Autorecovering storage domains is disabled, skipping >2012-12-23 09:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts >2012-12-23 09:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 hosts >2012-12-23 09:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts done >2012-12-23 09:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering storage domains is disabled, skipping >2012-12-23 10:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts >2012-12-23 10:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering 0 hosts >2012-12-23 10:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Checking autorecoverable hosts done >2012-12-23 10:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) Autorecovering storage domains is disabled, skipping >2012-12-23 10:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts >2012-12-23 10:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering 0 hosts >2012-12-23 10:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts done >2012-12-23 10:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering storage domains is disabled, skipping >2012-12-23 10:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts >2012-12-23 10:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering 0 hosts >2012-12-23 10:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Checking autorecoverable hosts done >2012-12-23 10:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [512ffd55] Autorecovering storage domains is disabled, skipping >2012-12-23 10:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts >2012-12-23 10:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering 0 hosts >2012-12-23 10:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Checking autorecoverable hosts done >2012-12-23 10:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-20) Autorecovering storage domains is disabled, skipping >2012-12-23 10:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts >2012-12-23 10:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering 0 hosts >2012-12-23 10:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Checking autorecoverable hosts done >2012-12-23 10:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-61) Autorecovering storage domains is disabled, skipping >2012-12-23 10:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Checking autorecoverable hosts >2012-12-23 10:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Autorecovering 0 hosts >2012-12-23 10:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Checking autorecoverable hosts done >2012-12-23 10:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Autorecovering storage domains is disabled, skipping >2012-12-23 10:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts >2012-12-23 10:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 hosts >2012-12-23 10:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts done >2012-12-23 10:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering storage domains is disabled, skipping >2012-12-23 10:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-12-23 10:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-12-23 10:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-12-23 10:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering storage domains is disabled, skipping >2012-12-23 10:38:25,856 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Checking if user admin@internal is an admin, result true >2012-12-23 10:38:25,857 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginAdminUserCommand internal: false. >2012-12-23 10:38:45,551 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-6) Lock Acquired to object EngineLock [exclusiveLocks= key: 80ab027c-2d2a-498a-94ec-bfb290566e65 value: VM_DISK_BOOT >, sharedLocks= key: 80ab027c-2d2a-498a-94ec-bfb290566e65 value: VM >] >2012-12-23 10:38:45,555 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-6) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 40f7d9b2 >2012-12-23 10:38:45,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-6) FINISH, IsValidVDSCommand, return: true, log id: 40f7d9b2 >2012-12-23 10:38:45,642 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) [66e92ba5] Running command: AddDiskCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:45,920 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [1c778d6f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:45,962 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [1c778d6f] Lock freed to object EngineLock [exclusiveLocks= key: 80ab027c-2d2a-498a-94ec-bfb290566e65 value: VM_DISK_BOOT >, sharedLocks= key: 80ab027c-2d2a-498a-94ec-bfb290566e65 value: VM >] >2012-12-23 10:38:45,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [1c778d6f] START, CreateImageVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2, imageSizeInBytes = 32212254720, volumeFormat = RAW, newImageId = a6e1a3f9-e525-48a7-acb6-e29a879358de, newImageDescription = ), log id: 3fb163ac >2012-12-23 10:38:45,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [1c778d6f] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-12-23 10:38:45,964 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [1c778d6f] -- createVolume parameters: > sdUUID=7ce7e233-140b-4086-8fbb-a81247665e51 > spUUID=4027fdea-c811-4bf2-b779-25dbdcacbea5 > imgGUID=07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2 > size=32,212,254,720 bytes > volFormat=RAW > volType=Sparse > volUUID=a6e1a3f9-e525-48a7-acb6-e29a879358de > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-12-23 10:38:46,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [1c778d6f] FINISH, CreateImageVDSCommand, return: a6e1a3f9-e525-48a7-acb6-e29a879358de, log id: 3fb163ac >2012-12-23 10:38:46,268 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) [1c778d6f] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2 >2012-12-23 10:38:46,268 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [1c778d6f] EntityMultiAsyncTasks::AttachTask: Attaching task 0baadc31-6813-4034-ae8d-d973da842a69 to entity 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2. >2012-12-23 10:38:46,275 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-49) [1c778d6f] Adding task 0baadc31-6813-4034-ae8d-d973da842a69 to DataBase >2012-12-23 10:38:46,382 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-49) [1c778d6f] Adding task 0baadc31-6813-4034-ae8d-d973da842a69 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-12-23 10:38:46,713 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) [1c778d6f] BaseAsyncTask::StartPollingTask: Starting to poll task 0baadc31-6813-4034-ae8d-d973da842a69. >2012-12-23 10:38:46,713 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [1c778d6f] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2 is AddDisk (determined by task 0baadc31-6813-4034-ae8d-d973da842a69) >2012-12-23 10:38:50,291 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-1) Lock Acquired to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM_DISK_BOOT >, sharedLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >] >2012-12-23 10:38:50,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-1) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5c613839 >2012-12-23 10:38:50,302 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, IsValidVDSCommand, return: true, log id: 5c613839 >2012-12-23 10:38:50,608 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) [28a21871] Running command: AddDiskCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM, ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:50,976 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [7cbd0f6f] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:51,011 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [7cbd0f6f] Lock freed to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM_DISK_BOOT >, sharedLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >] >2012-12-23 10:38:51,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [7cbd0f6f] START, CreateImageVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 9191f74c-2ada-4b24-9b52-218e5748f763, imageSizeInBytes = 32212254720, volumeFormat = RAW, newImageId = 8e9c7b76-09a9-433f-863e-92645c1571b9, newImageDescription = ), log id: 44c7fd99 >2012-12-23 10:38:51,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [7cbd0f6f] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-12-23 10:38:51,013 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [7cbd0f6f] -- createVolume parameters: > sdUUID=7ce7e233-140b-4086-8fbb-a81247665e51 > spUUID=4027fdea-c811-4bf2-b779-25dbdcacbea5 > imgGUID=9191f74c-2ada-4b24-9b52-218e5748f763 > size=32,212,254,720 bytes > volFormat=RAW > volType=Sparse > volUUID=8e9c7b76-09a9-433f-863e-92645c1571b9 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-12-23 10:38:51,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [7cbd0f6f] FINISH, CreateImageVDSCommand, return: 8e9c7b76-09a9-433f-863e-92645c1571b9, log id: 44c7fd99 >2012-12-23 10:38:51,335 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) [7cbd0f6f] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 9191f74c-2ada-4b24-9b52-218e5748f763 >2012-12-23 10:38:51,335 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [7cbd0f6f] EntityMultiAsyncTasks::AttachTask: Attaching task 2e169999-2ae9-4e44-abba-68ec23bf3a57 to entity 9191f74c-2ada-4b24-9b52-218e5748f763. >2012-12-23 10:38:51,336 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-49) [7cbd0f6f] Adding task 2e169999-2ae9-4e44-abba-68ec23bf3a57 to DataBase >2012-12-23 10:38:51,415 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-49) [7cbd0f6f] Adding task 2e169999-2ae9-4e44-abba-68ec23bf3a57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-12-23 10:38:51,606 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) [7cbd0f6f] BaseAsyncTask::StartPollingTask: Starting to poll task 2e169999-2ae9-4e44-abba-68ec23bf3a57. >2012-12-23 10:38:51,606 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [7cbd0f6f] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 9191f74c-2ada-4b24-9b52-218e5748f763 is AddDisk (determined by task 2e169999-2ae9-4e44-abba-68ec23bf3a57) >2012-12-23 10:38:52,533 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-34) [2aa79518] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now >2012-12-23 10:38:52,571 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] SPMAsyncTask::PollTask: Polling task 2e169999-2ae9-4e44-abba-68ec23bf3a57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-12-23 10:38:52,594 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] BaseAsyncTask::OnTaskEndSuccess: Task 2e169999-2ae9-4e44-abba-68ec23bf3a57 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-12-23 10:38:52,594 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] EntityAsyncTask::EndActionIfNecessary: All tasks of entity 9191f74c-2ada-4b24-9b52-218e5748f763 has ended -> executing EndAction >2012-12-23 10:38:52,594 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 9191f74c-2ada-4b24-9b52-218e5748f763): calling EndAction for action type AddDisk. >2012-12-23 10:38:52,595 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] SPMAsyncTask::PollTask: Polling task 0baadc31-6813-4034-ae8d-d973da842a69 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-12-23 10:38:52,596 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) [2aa79518] EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2012-12-23 10:38:52,626 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] BaseAsyncTask::OnTaskEndSuccess: Task 0baadc31-6813-4034-ae8d-d973da842a69 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-12-23 10:38:52,627 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] EntityAsyncTask::EndActionIfNecessary: All tasks of entity 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2 has ended -> executing EndAction >2012-12-23 10:38:52,627 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-34) [2aa79518] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2): calling EndAction for action type AddDisk. >2012-12-23 10:38:52,627 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) [2aa79518] EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2012-12-23 10:38:52,699 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) [2aa79518] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-12-23 10:38:52,699 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [7cbd0f6f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-12-23 10:38:52,710 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [7cbd0f6f] START, GetImageInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 9191f74c-2ada-4b24-9b52-218e5748f763, imageId = 8e9c7b76-09a9-433f-863e-92645c1571b9), log id: 4c1ba433 >2012-12-23 10:38:52,745 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-50) [2aa79518] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-12-23 10:38:52,745 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-50) [1c778d6f] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-12-23 10:38:52,756 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [1c778d6f] START, GetImageInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2, imageId = a6e1a3f9-e525-48a7-acb6-e29a879358de), log id: 7d47d524 >2012-12-23 10:38:52,782 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [7cbd0f6f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@242f4e54, log id: 4c1ba433 >2012-12-23 10:38:52,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [1c778d6f] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@e4d58974, log id: 7d47d524 >2012-12-23 10:38:52,990 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 2a9994cf >2012-12-23 10:38:53,041 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 662c6d2b >2012-12-23 10:38:53,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 2a9994cf >2012-12-23 10:38:53,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) FINISH, UpdateVMVDSCommand, log id: 662c6d2b >2012-12-23 10:38:53,191 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-12-23 10:38:53,191 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-12-23 10:38:53,249 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 2e169999-2ae9-4e44-abba-68ec23bf3a57 >2012-12-23 10:38:53,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 2e169999-2ae9-4e44-abba-68ec23bf3a57), log id: 165a9860 >2012-12-23 10:38:54,326 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-12-23 10:38:54,326 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-12-23 10:38:54,395 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 0baadc31-6813-4034-ae8d-d973da842a69 >2012-12-23 10:38:54,395 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 0baadc31-6813-4034-ae8d-d973da842a69), log id: 2a0913f0 >2012-12-23 10:38:54,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, taskId=0baadc31-6813-4034-ae8d-d973da842a69), log id: 18ee890b >2012-12-23 10:38:54,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 18ee890b >2012-12-23 10:38:54,578 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 2a0913f0 >2012-12-23 10:38:54,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, taskId=2e169999-2ae9-4e44-abba-68ec23bf3a57), log id: 2dfd9ee9 >2012-12-23 10:38:54,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 2dfd9ee9 >2012-12-23 10:38:54,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 165a9860 >2012-12-23 10:38:54,632 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 0baadc31-6813-4034-ae8d-d973da842a69 from DataBase >2012-12-23 10:38:54,632 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 07e97477-fbba-4e6a-a9d1-03e0eb1ae4e2 >2012-12-23 10:38:54,641 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 2e169999-2ae9-4e44-abba-68ec23bf3a57 from DataBase >2012-12-23 10:38:54,641 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 9191f74c-2ada-4b24-9b52-218e5748f763 >2012-12-23 10:38:55,322 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-5) Lock Acquired to object EngineLock [exclusiveLocks= key: 22ee2cb6-d617-44ce-b650-d16607825589 value: VM_DISK_BOOT >, sharedLocks= key: 22ee2cb6-d617-44ce-b650-d16607825589 value: VM >] >2012-12-23 10:38:55,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-5) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5cfd5a34 >2012-12-23 10:38:55,328 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, IsValidVDSCommand, return: true, log id: 5cfd5a34 >2012-12-23 10:38:55,688 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) [49897363] Running command: AddDiskCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM, ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:56,229 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [501c36bc] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:56,268 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [501c36bc] Lock freed to object EngineLock [exclusiveLocks= key: 22ee2cb6-d617-44ce-b650-d16607825589 value: VM_DISK_BOOT >, sharedLocks= key: 22ee2cb6-d617-44ce-b650-d16607825589 value: VM >] >2012-12-23 10:38:56,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [501c36bc] START, CreateImageVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = e95fa962-0abf-4364-8a4b-4a4bb7803cf1, imageSizeInBytes = 32212254720, volumeFormat = RAW, newImageId = f1c3309d-36fb-49a1-99c2-ea7f9371338e, newImageDescription = ), log id: 167a68ce >2012-12-23 10:38:56,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [501c36bc] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-12-23 10:38:56,270 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [501c36bc] -- createVolume parameters: > sdUUID=7ce7e233-140b-4086-8fbb-a81247665e51 > spUUID=4027fdea-c811-4bf2-b779-25dbdcacbea5 > imgGUID=e95fa962-0abf-4364-8a4b-4a4bb7803cf1 > size=32,212,254,720 bytes > volFormat=RAW > volType=Sparse > volUUID=f1c3309d-36fb-49a1-99c2-ea7f9371338e > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-12-23 10:38:56,857 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [501c36bc] FINISH, CreateImageVDSCommand, return: f1c3309d-36fb-49a1-99c2-ea7f9371338e, log id: 167a68ce >2012-12-23 10:38:56,892 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) [501c36bc] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity e95fa962-0abf-4364-8a4b-4a4bb7803cf1 >2012-12-23 10:38:56,892 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [501c36bc] EntityMultiAsyncTasks::AttachTask: Attaching task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 to entity e95fa962-0abf-4364-8a4b-4a4bb7803cf1. >2012-12-23 10:38:56,893 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-49) [501c36bc] Adding task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 to DataBase >2012-12-23 10:38:56,959 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-49) [501c36bc] Adding task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-12-23 10:38:57,153 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) [501c36bc] BaseAsyncTask::StartPollingTask: Starting to poll task 145b9bc0-1a06-474f-bc58-6cff0e9c9901. >2012-12-23 10:38:57,153 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [501c36bc] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity e95fa962-0abf-4364-8a4b-4a4bb7803cf1 is AddDisk (determined by task 145b9bc0-1a06-474f-bc58-6cff0e9c9901) >2012-12-23 10:38:59,109 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-10) Lock Acquired to object EngineLock [exclusiveLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM_DISK_BOOT >, sharedLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM >] >2012-12-23 10:38:59,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3f4d3197 >2012-12-23 10:38:59,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, IsValidVDSCommand, return: true, log id: 3f4d3197 >2012-12-23 10:38:59,352 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) [1eeadef4] Running command: AddDiskCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM, ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:59,565 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [4ce919b2] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 10:38:59,637 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [4ce919b2] Lock freed to object EngineLock [exclusiveLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM_DISK_BOOT >, sharedLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM >] >2012-12-23 10:38:59,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [4ce919b2] START, CreateImageVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 13aa2d99-72c9-46a7-b5a5-4c5f377d806d, imageSizeInBytes = 32212254720, volumeFormat = RAW, newImageId = e2d74603-183a-487d-b80c-d32250f412df, newImageDescription = ), log id: b1de6d8 >2012-12-23 10:38:59,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [4ce919b2] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-12-23 10:38:59,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [4ce919b2] -- createVolume parameters: > sdUUID=7ce7e233-140b-4086-8fbb-a81247665e51 > spUUID=4027fdea-c811-4bf2-b779-25dbdcacbea5 > imgGUID=13aa2d99-72c9-46a7-b5a5-4c5f377d806d > size=32,212,254,720 bytes > volFormat=RAW > volType=Sparse > volUUID=e2d74603-183a-487d-b80c-d32250f412df > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-12-23 10:39:00,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (pool-3-thread-49) [4ce919b2] FINISH, CreateImageVDSCommand, return: e2d74603-183a-487d-b80c-d32250f412df, log id: b1de6d8 >2012-12-23 10:39:00,209 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) [4ce919b2] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 13aa2d99-72c9-46a7-b5a5-4c5f377d806d >2012-12-23 10:39:00,209 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [4ce919b2] EntityMultiAsyncTasks::AttachTask: Attaching task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c to entity 13aa2d99-72c9-46a7-b5a5-4c5f377d806d. >2012-12-23 10:39:00,210 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (pool-3-thread-49) [4ce919b2] Adding task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c to DataBase >2012-12-23 10:39:00,273 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (pool-3-thread-49) [4ce919b2] Adding task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-12-23 10:39:00,379 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) [4ce919b2] BaseAsyncTask::StartPollingTask: Starting to poll task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c. >2012-12-23 10:39:00,379 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (pool-3-thread-49) [4ce919b2] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 13aa2d99-72c9-46a7-b5a5-4c5f377d806d is AddDisk (determined by task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c) >2012-12-23 10:39:02,628 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-58) Polling and updating Async Tasks: 4 tasks, 2 tasks to poll now >2012-12-23 10:39:02,666 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-12-23 10:39:02,697 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-58) BaseAsyncTask::OnTaskEndSuccess: Task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-12-23 10:39:02,697 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-58) EntityAsyncTask::EndActionIfNecessary: All tasks of entity 13aa2d99-72c9-46a7-b5a5-4c5f377d806d has ended -> executing EndAction >2012-12-23 10:39:02,699 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-58) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 13aa2d99-72c9-46a7-b5a5-4c5f377d806d): calling EndAction for action type AddDisk. >2012-12-23 10:39:02,699 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-58) SPMAsyncTask::PollTask: Polling task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-12-23 10:39:02,702 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2012-12-23 10:39:02,714 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-58) BaseAsyncTask::OnTaskEndSuccess: Task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-12-23 10:39:02,715 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-58) EntityAsyncTask::EndActionIfNecessary: All tasks of entity e95fa962-0abf-4364-8a4b-4a4bb7803cf1 has ended -> executing EndAction >2012-12-23 10:39:02,715 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-58) EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: e95fa962-0abf-4364-8a4b-4a4bb7803cf1): calling EndAction for action type AddDisk. >2012-12-23 10:39:02,715 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2012-12-23 10:39:02,724 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-49) Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-12-23 10:39:02,724 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-49) [4ce919b2] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-12-23 10:39:02,726 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [4ce919b2] START, GetImageInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 13aa2d99-72c9-46a7-b5a5-4c5f377d806d, imageId = e2d74603-183a-487d-b80c-d32250f412df), log id: 203fd0b5 >2012-12-23 10:39:02,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-49) [4ce919b2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@beacc4a, log id: 203fd0b5 >2012-12-23 10:39:02,764 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-50) Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-12-23 10:39:02,765 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-50) [501c36bc] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-12-23 10:39:02,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [501c36bc] START, GetImageInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = e95fa962-0abf-4364-8a4b-4a4bb7803cf1, imageId = f1c3309d-36fb-49a1-99c2-ea7f9371338e), log id: 7d92f953 >2012-12-23 10:39:02,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 3a53d0a0 >2012-12-23 10:39:02,886 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-50) [501c36bc] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@77dafa44, log id: 7d92f953 >2012-12-23 10:39:02,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 12fb0f36 >2012-12-23 10:39:03,697 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-49) FINISH, UpdateVMVDSCommand, log id: 3a53d0a0 >2012-12-23 10:39:03,757 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-50) FINISH, UpdateVMVDSCommand, log id: 12fb0f36 >2012-12-23 10:39:04,563 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-12-23 10:39:04,563 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-12-23 10:39:05,080 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-12-23 10:39:05,080 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-12-23 10:39:05,114 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c >2012-12-23 10:39:05,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) START, SPMClearTaskVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 8cbf7d09-10e6-46de-ba82-cb5bb577d65c), log id: 144495b2 >2012-12-23 10:39:05,124 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 >2012-12-23 10:39:05,124 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) START, SPMClearTaskVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 145b9bc0-1a06-474f-bc58-6cff0e9c9901), log id: 22bfe383 >2012-12-23 10:39:05,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) START, HSMClearTaskVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, taskId=145b9bc0-1a06-474f-bc58-6cff0e9c9901), log id: 474c2178 >2012-12-23 10:39:05,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-50) FINISH, HSMClearTaskVDSCommand, log id: 474c2178 >2012-12-23 10:39:05,192 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-50) FINISH, SPMClearTaskVDSCommand, log id: 22bfe383 >2012-12-23 10:39:05,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) START, HSMClearTaskVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, taskId=8cbf7d09-10e6-46de-ba82-cb5bb577d65c), log id: 5b752751 >2012-12-23 10:39:05,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-49) FINISH, HSMClearTaskVDSCommand, log id: 5b752751 >2012-12-23 10:39:05,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-49) FINISH, SPMClearTaskVDSCommand, log id: 144495b2 >2012-12-23 10:39:05,234 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-50) BaseAsyncTask::RemoveTaskFromDB: Removed task 145b9bc0-1a06-474f-bc58-6cff0e9c9901 from DataBase >2012-12-23 10:39:05,234 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-50) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity e95fa962-0abf-4364-8a4b-4a4bb7803cf1 >2012-12-23 10:39:05,284 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-49) BaseAsyncTask::RemoveTaskFromDB: Removed task 8cbf7d09-10e6-46de-ba82-cb5bb577d65c from DataBase >2012-12-23 10:39:05,284 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-49) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 13aa2d99-72c9-46a7-b5a5-4c5f377d806d >2012-12-23 10:39:11,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6f9a8b1e >2012-12-23 10:39:11,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] FINISH, IsValidVDSCommand, return: true, log id: 6f9a8b1e >2012-12-23 10:39:11,951 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] START, IsVmDuringInitiatingVDSCommand( vmId = 80ab027c-2d2a-498a-94ec-bfb290566e65), log id: 62f4efdb >2012-12-23 10:39:11,951 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 62f4efdb >2012-12-23 10:39:12,062 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 10:39:12,083 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] START, CreateVmVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vm=org.ovirt.engine.core.common.businessentities.VM@468bf663), log id: 815a7d3 >2012-12-23 10:39:12,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] START, CreateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vm=org.ovirt.engine.core.common.businessentities.VM@468bf663), log id: 7e65f80c >2012-12-23 10:39:12,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=80ab027c-2d2a-498a-94ec-bfb290566e65,devices=[Ljava.util.Map;@2b8eeb35,acpiEnable=true,vmName=vm1,cpuType=Conroe,custom={} >2012-12-23 10:39:12,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] FINISH, CreateVDSCommand, log id: 7e65f80c >2012-12-23 10:39:12,142 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] IncreasePendingVms::CreateVmIncreasing vds orchid-vds2 pending vcpu count, now 1. Vm: vm1 >2012-12-23 10:39:12,152 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-4) [76d97a71] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 815a7d3 >2012-12-23 10:39:15,408 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-43) VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from WaitForLaunch --> PoweringUp >2012-12-23 10:39:15,408 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-43) START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 7c085c >2012-12-23 10:39:15,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-43) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4f08d043, log id: 7c085c >2012-12-23 10:39:18,548 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-2) [2fd9f352] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 10:39:18,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [2fd9f352] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=krRs/byFR4gZ, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 31a7fdca >2012-12-23 10:39:18,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-2) [2fd9f352] FINISH, SetVmTicketVDSCommand, log id: 31a7fdca >2012-12-23 10:39:36,989 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-9) [1def2c07] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 10:39:36,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [1def2c07] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=s4RA9FmDx6KN, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 2cdee34a >2012-12-23 10:39:37,100 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-9) [1def2c07] FINISH, SetVmTicketVDSCommand, log id: 2cdee34a >2012-12-23 10:39:57,372 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-30) [f0b7261] Setting new tasks map. The map contains now 2 tasks >2012-12-23 10:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts >2012-12-23 10:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering 0 hosts >2012-12-23 10:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Checking autorecoverable hosts done >2012-12-23 10:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) Autorecovering storage domains is disabled, skipping >2012-12-23 10:40:12,274 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from PoweringUp --> Up >2012-12-23 10:40:12,607 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-93) START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@d4be8f03), log id: 7ad23136 >2012-12-23 10:40:12,626 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-93) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 7ad23136 >2012-12-23 10:40:13,318 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-3) Lock Acquired to object EngineLock [exclusiveLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM >, sharedLocks= ] >2012-12-23 10:40:13,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-3) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 211e2fe6 >2012-12-23 10:40:13,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, IsValidVDSCommand, return: true, log id: 211e2fe6 >2012-12-23 10:40:13,421 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) START, IsVmDuringInitiatingVDSCommand( vmId = ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6), log id: f0aa4f5 >2012-12-23 10:40:13,421 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-3) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: f0aa4f5 >2012-12-23 10:40:14,789 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [be5600f] Running command: RunVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 10:40:14,870 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-48) [be5600f] START, CreateVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vm=org.ovirt.engine.core.common.businessentities.VM@2108d2a5), log id: bc05259 >2012-12-23 10:40:14,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-48) [be5600f] START, CreateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vm=org.ovirt.engine.core.common.businessentities.VM@2108d2a5), log id: 3365746e >2012-12-23 10:40:14,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-48) [be5600f] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6,devices=[Ljava.util.Map;@2b3b0b50,acpiEnable=true,vmName=vm4,cpuType=Conroe,custom={} >2012-12-23 10:40:14,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-48) [be5600f] FINISH, CreateVDSCommand, log id: 3365746e >2012-12-23 10:40:14,941 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-48) [be5600f] IncreasePendingVms::CreateVmIncreasing vds orchid-vds1 pending vcpu count, now 1. Vm: vm4 >2012-12-23 10:40:14,982 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-48) [be5600f] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: bc05259 >2012-12-23 10:40:14,982 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-48) [be5600f] Lock freed to object EngineLock [exclusiveLocks= key: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 value: VM >, sharedLocks= ] >2012-12-23 10:40:20,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-76) [947a8e6] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 5fb25f15 >2012-12-23 10:40:20,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-76) [947a8e6] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@37808cc8, log id: 5fb25f15 >2012-12-23 10:40:20,615 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] Recieved a qxl Device without an address when processing VM ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 devices, skipping device: {specParams={vram=65536}, device=qxl, type=video, deviceId=3dbabdba-2cae-4e2a-abac-44b2f70733dc} >2012-12-23 10:40:20,615 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] Recieved a bridge Device without an address when processing VM ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 devices, skipping device: {nicModel=pv, specParams={}, device=bridge, macAddr=00:1a:4a:16:88:52, type=interface, portMirroring=[Ljava.lang.Object;@d2763f0, deviceId=6ae7f728-924d-44ce-8dfe-dde5edcc7554, filter=vdsm-no-mac-spoofing, network=rhevm} >2012-12-23 10:40:20,615 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] Recieved a memballoon Device without an address when processing VM ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 devices, skipping device: {specParams={model=virtio}, device=memballoon, type=balloon, deviceId=137763d0-1b52-40f8-ad2a-d3c15c94b52a} >2012-12-23 10:40:20,615 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] Recieved a cdrom Device without an address when processing VM ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 devices, skipping device: {shared=false, iface=ide, index=2, specParams={path=}, device=cdrom, path=, type=disk, readonly=true, deviceId=f9938b71-661c-498f-96ad-869dfb60404a} >2012-12-23 10:40:20,615 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] Recieved a disk Device without an address when processing VM ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 devices, skipping device: {shared=false, index=0, volumeID=e2d74603-183a-487d-b80c-d32250f412df, propagateErrors=off, format=raw, type=disk, truesize=0, reqsize=0, iface=virtio, volumeChain=[Ljava.lang.Object;@1512284f, imageID=13aa2d99-72c9-46a7-b5a5-4c5f377d806d, domainID=7ce7e233-140b-4086-8fbb-a81247665e51, specParams={}, optional=false, path=/rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7ce7e233-140b-4086-8fbb-a81247665e51/images/13aa2d99-72c9-46a7-b5a5-4c5f377d806d/e2d74603-183a-487d-b80c-d32250f412df, device=disk, poolID=4027fdea-c811-4bf2-b779-25dbdcacbea5, readonly=false, apparentsize=32212254720, deviceId=13aa2d99-72c9-46a7-b5a5-4c5f377d806d} >2012-12-23 10:40:22,801 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 moved from WaitForLaunch --> PoweringUp >2012-12-23 10:40:22,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-26) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 22ae7041 >2012-12-23 10:40:22,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-26) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6a4bcd30, log id: 22ae7041 >2012-12-23 10:40:26,006 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-5) [4781fd9f] Running command: SetVmTicketCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 10:40:26,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [4781fd9f] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, ticket=b8xg2t4Gqqc0, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 684b488e >2012-12-23 10:40:26,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [4781fd9f] FINISH, SetVmTicketVDSCommand, log id: 684b488e >2012-12-23 10:40:27,372 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) [15a44b8e] Setting new tasks map. The map contains now 0 tasks >2012-12-23 10:40:27,373 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) [15a44b8e] Cleared all tasks of pool 4027fdea-c811-4bf2-b779-25dbdcacbea5. >2012-12-23 10:40:27,375 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-51) [15a44b8e] Could not find vds that is spm and non-operational. >2012-12-23 10:41:16,147 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-26) VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 moved from PoweringUp --> Up >2012-12-23 10:41:16,274 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-26) START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@b53ba977), log id: 2a1d846b >2012-12-23 10:41:16,283 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-26) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 2a1d846b >2012-12-23 10:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Checking autorecoverable hosts >2012-12-23 10:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Autorecovering 0 hosts >2012-12-23 10:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Checking autorecoverable hosts done >2012-12-23 10:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Autorecovering storage domains is disabled, skipping >2012-12-23 10:45:16,668 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp-/127.0.0.1:8702-2) [72dfa5e8] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 65dc119d >2012-12-23 10:45:16,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp-/127.0.0.1:8702-2) [72dfa5e8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 65dc119d >2012-12-23 10:45:16,735 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [72dfa5e8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 10:45:16,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [72dfa5e8] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 78ca6ed2 >2012-12-23 10:45:16,842 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [72dfa5e8] FINISH, ConnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 78ca6ed2 >2012-12-23 10:45:16,880 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp-/127.0.0.1:8702-10) START, GetExistingStorageDomainListQuery(org.ovirt.engine.core.common.queries.GetExistingStorageDomainListParameters@665ffe93), log id: 2d1d6b10 >2012-12-23 10:45:16,887 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-10) START, HSMGetStorageDomainsListVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=NFS, storageDomainType=ISO, path=lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1), log id: 4f91e195 >2012-12-23 10:45:22,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, HSMGetStorageDomainsListVDSCommand, return: [7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6], log id: 4f91e195 >2012-12-23 10:45:22,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-10) START, HSMGetStorageDomainInfoVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storageDomainId=7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6), log id: 7bfdd116 >2012-12-23 10:45:22,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-10) FINISH, HSMGetStorageDomainInfoVDSCommand, return: org.ovirt.engine.core.utils.Pair@1eb0f93c, log id: 7bfdd116 >2012-12-23 10:45:22,094 INFO [org.ovirt.engine.core.bll.storage.GetExistingStorageDomainListQuery] (ajp-/127.0.0.1:8702-10) FINISH, GetExistingStorageDomainListQuery, log id: 2d1d6b10 >2012-12-23 10:45:22,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] START, HSMGetStorageDomainsListVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId=00000000-0000-0000-0000-000000000000, storageType=NFS, storageDomainType=ISO, path=), log id: 2694ba8a >2012-12-23 10:45:26,462 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainsListVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] FINISH, HSMGetStorageDomainsListVDSCommand, return: [7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6], log id: 2694ba8a >2012-12-23 10:45:26,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] START, HSMGetStorageDomainInfoVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storageDomainId=7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6), log id: 2bbe4022 >2012-12-23 10:45:26,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] FINISH, HSMGetStorageDomainInfoVDSCommand, return: org.ovirt.engine.core.utils.Pair@1eb0f93c, log id: 2bbe4022 >2012-12-23 10:45:26,543 INFO [org.ovirt.engine.core.bll.storage.AddExistingNFSStorageDomainCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] Running command: AddExistingNFSStorageDomainCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 10:45:26,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] START, GetStorageDomainStatsVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storageDomainId=7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6), log id: 344b01e5 >2012-12-23 10:45:26,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStorageDomainStatsVDSCommand] (ajp-/127.0.0.1:8702-1) [64f53b2e] FINISH, GetStorageDomainStatsVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage_domains@f1430ec8, log id: 344b01e5 >2012-12-23 10:45:26,779 INFO [org.ovirt.engine.core.bll.storage.RemoveStorageServerConnectionCommand] (ajp-/127.0.0.1:8702-2) [581e9673] Running command: RemoveStorageServerConnectionCommand internal: false. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 10:45:26,780 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [581e9673] START, DisconnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: null, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 465468f8 >2012-12-23 10:45:26,871 INFO [org.ovirt.engine.core.bll.storage.AttachStorageDomainToPoolCommand] (ajp-/127.0.0.1:8702-5) [7ff38202] Running command: AttachStorageDomainToPoolCommand internal: false. Entities affected : ID: 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 Type: Storage >2012-12-23 10:45:26,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-48) [1506416a] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 504cc6ad >2012-12-23 10:45:26,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-50) [754e72b] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 19b7b7bc >2012-12-23 10:45:26,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-48) [1506416a] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 504cc6ad >2012-12-23 10:45:26,961 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-48) [1506416a] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 10:45:26,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1506416a] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2a319632 >2012-12-23 10:45:26,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-50) [754e72b] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 19b7b7bc >2012-12-23 10:45:26,964 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-50) [754e72b] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 10:45:26,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [754e72b] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 9194c02 >2012-12-23 10:45:27,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-48) [1506416a] FINISH, ConnectStorageServerVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 2a319632 >2012-12-23 10:45:27,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [754e72b] FINISH, ConnectStorageServerVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 9194c02 >2012-12-23 10:45:27,086 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [7ff38202] START, AttachStorageDomainVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6), log id: 6ad554 >2012-12-23 10:45:29,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (ajp-/127.0.0.1:8702-2) [581e9673] FINISH, DisconnectStorageServerVDSCommand, return: {00000000-0000-0000-0000-000000000000=0}, log id: 465468f8 >2012-12-23 10:45:41,840 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.AttachStorageDomainVDSCommand] (ajp-/127.0.0.1:8702-5) [7ff38202] FINISH, AttachStorageDomainVDSCommand, log id: 6ad554 >2012-12-23 10:47:45,233 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-58) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 10:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts >2012-12-23 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering 0 hosts >2012-12-23 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Checking autorecoverable hosts done >2012-12-23 10:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-66) [5f7c22ad] Autorecovering storage domains is disabled, skipping >2012-12-23 10:50:57,965 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from Up --> RebootInProgress >2012-12-23 10:50:57,966 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-94) START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 149c93f9 >2012-12-23 10:50:57,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-94) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@3de0ce6d, log id: 149c93f9 >2012-12-23 10:51:18,504 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-82) VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 moved from Up --> RebootInProgress >2012-12-23 10:51:18,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 285e4658 >2012-12-23 10:51:18,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@455c501c, log id: 285e4658 >2012-12-23 10:51:49,546 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) [15a44b8e] VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from RebootInProgress --> Up >2012-12-23 10:52:16,768 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 moved from RebootInProgress --> Up >2012-12-23 10:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts >2012-12-23 10:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering 0 hosts >2012-12-23 10:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Checking autorecoverable hosts done >2012-12-23 10:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-37) Autorecovering storage domains is disabled, skipping >2012-12-23 11:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts >2012-12-23 11:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering 0 hosts >2012-12-23 11:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Checking autorecoverable hosts done >2012-12-23 11:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) Autorecovering storage domains is disabled, skipping >2012-12-23 11:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Checking autorecoverable hosts >2012-12-23 11:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Autorecovering 0 hosts >2012-12-23 11:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Checking autorecoverable hosts done >2012-12-23 11:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [2d2ac2e6] Autorecovering storage domains is disabled, skipping >2012-12-23 11:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts >2012-12-23 11:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering 0 hosts >2012-12-23 11:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Checking autorecoverable hosts done >2012-12-23 11:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-36) Autorecovering storage domains is disabled, skipping >2012-12-23 11:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts >2012-12-23 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering 0 hosts >2012-12-23 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Checking autorecoverable hosts done >2012-12-23 11:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) Autorecovering storage domains is disabled, skipping >2012-12-23 11:17:49,840 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-5) [5b2b8e08] Running command: LogoutUserCommand internal: false. >2012-12-23 11:18:54,141 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-8) Checking if user admin@internal is an admin, result true >2012-12-23 11:18:54,141 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-8) Running command: LoginAdminUserCommand internal: false. >2012-12-23 11:19:29,103 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (ajp-/127.0.0.1:8702-7) Lock Acquired to object EngineLock [exclusiveLocks= key: 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 value: STORAGE >, sharedLocks= ] >2012-12-23 11:19:29,263 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-49) [56785b07] Running command: ActivateStorageDomainCommand internal: false. Entities affected : ID: 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 Type: Storage >2012-12-23 11:19:29,299 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-49) [56785b07] Lock freed to object EngineLock [exclusiveLocks= key: 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6 value: STORAGE >, sharedLocks= ] >2012-12-23 11:19:29,299 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-49) [56785b07] ActivateStorage Domain. Before Connect all hosts to pool. Time:12/23/12 11:19 AM >2012-12-23 11:19:29,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-45) [120785e] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 20a959bb >2012-12-23 11:19:29,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-50) [387ca6ca] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 334f3808 >2012-12-23 11:19:29,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-45) [120785e] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 20a959bb >2012-12-23 11:19:29,346 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-45) [120785e] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 11:19:29,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [120785e] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 6cab66fb >2012-12-23 11:19:29,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (pool-3-thread-50) [387ca6ca] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 334f3808 >2012-12-23 11:19:29,354 INFO [org.ovirt.engine.core.bll.storage.ConnectStorageToVdsCommand] (pool-3-thread-50) [387ca6ca] Running command: ConnectStorageToVdsCommand internal: true. Entities affected : ID: aaa00000-0000-0000-0000-123456789aaa Type: System >2012-12-23 11:19:29,355 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [387ca6ca] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 00000000-0000-0000-0000-000000000000, storageType = NFS, connectionList = [{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5928f976 >2012-12-23 11:19:29,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-45) [120785e] FINISH, ConnectStorageServerVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 6cab66fb >2012-12-23 11:19:29,385 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (pool-3-thread-50) [387ca6ca] FINISH, ConnectStorageServerVDSCommand, return: {8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 5928f976 >2012-12-23 11:19:29,385 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-49) [56785b07] START, ActivateStorageDomainVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6), log id: 1f00a74b >2012-12-23 11:19:29,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ActivateStorageDomainVDSCommand] (pool-3-thread-49) [56785b07] FINISH, ActivateStorageDomainVDSCommand, log id: 1f00a74b >2012-12-23 11:19:29,540 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-49) [56785b07] ActivateStorage Domain. After Connect all hosts to pool. Time:12/23/12 11:19 AM >2012-12-23 11:19:29,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-46) [56785b07] START, RefreshStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, masterStorageDomainId=7ce7e233-140b-4086-8fbb-a81247665e51, msterVersion=1), log id: 5776163 >2012-12-23 11:19:29,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-50) [56785b07] START, RefreshStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, masterStorageDomainId=7ce7e233-140b-4086-8fbb-a81247665e51, msterVersion=1), log id: defeadc >2012-12-23 11:19:33,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-50) [56785b07] FINISH, RefreshStoragePoolVDSCommand, log id: defeadc >2012-12-23 11:19:33,117 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-50) [56785b07] Refreshed vds orchid-vds1 in pool DC31-CLI >2012-12-23 11:19:34,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.RefreshStoragePoolVDSCommand] (pool-3-thread-46) [56785b07] FINISH, RefreshStoragePoolVDSCommand, log id: 5776163 >2012-12-23 11:19:34,150 INFO [org.ovirt.engine.core.bll.storage.RefreshPoolSingleAsyncOperation] (pool-3-thread-46) [56785b07] Refreshed vds orchid-vds2 in pool DC31-CLI >2012-12-23 11:19:34,240 INFO [org.ovirt.engine.core.bll.storage.ActivateStorageDomainCommand] (pool-3-thread-49) [56785b07] ActivateStorage Domain. After change storage pool status in vds. Time:12/23/12 11:19 AM >2012-12-23 11:19:34,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-46) [56785b07] START, GetIsoListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7b391508 >2012-12-23 11:19:34,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-46) [56785b07] START, HsmGetIsoListVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId=4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 2866b9db >2012-12-23 11:19:34,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-46) [56785b07] FINISH, HsmGetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 2866b9db >2012-12-23 11:19:34,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-46) [56785b07] FINISH, GetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 7b391508 >2012-12-23 11:19:34,561 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-46) [56785b07] START, GetFloppyListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1ebcc091 >2012-12-23 11:19:34,614 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-46) [56785b07] FINISH, GetFloppyListVDSCommand, return: [win7-64.vfd, win2003-x64-unattended.vfd, win2k8-R2.vfd, win7x64_with_virtio.vfd, win7-32.vfd, win2k3-64-with-virtio.vfd, win2003-32-unattended.vfd, win2000-Pro-unattended.vfd, win2k3-32-with-virtio.vfd, win2k8-32_with_virtio.vfd, virtio-drivers-1.0.0-45801.vfd, win2k3.vfd, winxp.vfd, win2k3x64.vfd, virtio-win-1.4.0.vfd, winXP-Pro-SP2-32-unattended.vfd, virtio-drivers.vfd, virtio-win-1.1.16.vfd, winXP-x64-unattended.vfd, win7-32_with_virtio.vfd, winxp_32_virtio.vfd, virtio-drivers-1.0.0-8.vfd, win2k8-R2_with_virtio.vfd], log id: 1ebcc091 >2012-12-23 11:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Checking autorecoverable hosts >2012-12-23 11:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Autorecovering 0 hosts >2012-12-23 11:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Checking autorecoverable hosts done >2012-12-23 11:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-81) [15499fea] Autorecovering storage domains is disabled, skipping >2012-12-23 11:20:47,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4bd1b987 >2012-12-23 11:20:47,586 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 4bd1b987 >2012-12-23 11:20:47,586 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7aab91b3 >2012-12-23 11:20:47,586 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 7aab91b3 >2012-12-23 11:20:47,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1dac6d13 >2012-12-23 11:20:47,655 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, IsValidVDSCommand, return: true, log id: 1dac6d13 >2012-12-23 11:20:47,771 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, IsVmDuringInitiatingVDSCommand( vmId = 2e79d247-3ef0-4fc5-b865-ed1092c89a89), log id: 311f3215 >2012-12-23 11:20:47,771 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 311f3215 >2012-12-23 11:20:47,833 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 11:20:47,857 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, CreateVmVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@597f0603), log id: 5b3ca908 >2012-12-23 11:20:47,862 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] START, CreateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@597f0603), log id: 88ed69 >2012-12-23 11:20:47,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89,devices=[Ljava.util.Map;@2d66c819,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={} >2012-12-23 11:20:47,916 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, CreateVDSCommand, log id: 88ed69 >2012-12-23 11:20:47,917 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] IncreasePendingVms::CreateVmIncreasing vds orchid-vds2 pending vcpu count, now 1. Vm: vm2 >2012-12-23 11:20:47,937 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-10) [70783e2e] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 5b3ca908 >2012-12-23 11:20:53,283 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-34) [2aa79518] VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from WaitForLaunch --> PoweringUp >2012-12-23 11:20:53,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-34) [2aa79518] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 3de6decc >2012-12-23 11:20:53,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-34) [2aa79518] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2d42d4, log id: 3de6decc >2012-12-23 11:20:58,945 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-6) [11dd8e28] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 11:20:58,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [11dd8e28] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, ticket=OXWccIiYfaFj, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: de80c3d >2012-12-23 11:20:59,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [11dd8e28] FINISH, SetVmTicketVDSCommand, log id: de80c3d >2012-12-23 11:21:48,820 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-5) [3717512e] VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from PoweringUp --> Up >2012-12-23 11:21:49,154 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-5) [3717512e] START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@4f1e617b), log id: 5852d06d >2012-12-23 11:21:49,171 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-5) [3717512e] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5852d06d >2012-12-23 11:21:57,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 677e49df >2012-12-23 11:21:57,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] FINISH, IsValidVDSCommand, return: true, log id: 677e49df >2012-12-23 11:21:57,792 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] START, IsVmDuringInitiatingVDSCommand( vmId = 22ee2cb6-d617-44ce-b650-d16607825589), log id: 593aa05f >2012-12-23 11:21:57,792 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 593aa05f >2012-12-23 11:21:57,845 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] Running command: RunVmOnceCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 11:21:57,868 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2aa76d0 >2012-12-23 11:21:57,868 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 2aa76d0 >2012-12-23 11:21:57,869 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] START, CreateVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, vm=org.ovirt.engine.core.common.businessentities.VM@4d2e7f61), log id: 739ebee2 >2012-12-23 11:21:57,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] START, CreateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, vm=org.ovirt.engine.core.common.businessentities.VM@4d2e7f61), log id: 71d23f60 >2012-12-23 11:21:57,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=22ee2cb6-d617-44ce-b650-d16607825589,devices=[Ljava.util.Map;@3fdeb311,acpiEnable=true,vmName=vm3,cpuType=Conroe,custom={} >2012-12-23 11:21:57,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] FINISH, CreateVDSCommand, log id: 71d23f60 >2012-12-23 11:21:57,938 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] IncreasePendingVms::CreateVmIncreasing vds orchid-vds1 pending vcpu count, now 1. Vm: vm3 >2012-12-23 11:21:57,943 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-1) [6f500fdc] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 739ebee2 >2012-12-23 11:22:00,251 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 moved from WaitForLaunch --> PoweringUp >2012-12-23 11:22:00,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-22) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[22ee2cb6-d617-44ce-b650-d16607825589]), log id: d058efb >2012-12-23 11:22:00,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-22) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@67ee076a, log id: d058efb >2012-12-23 11:22:04,897 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [5f8b676c] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 11:22:04,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [5f8b676c] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, ticket=DNwtn6wQpKjZ, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: ff131de >2012-12-23 11:22:04,993 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [5f8b676c] FINISH, SetVmTicketVDSCommand, log id: ff131de >2012-12-23 11:22:59,279 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-4) VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 moved from PoweringUp --> Up >2012-12-23 11:22:59,312 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-4) START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@9b76f65f), log id: 1670803d >2012-12-23 11:22:59,353 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-4) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 1670803d >2012-12-23 11:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts >2012-12-23 11:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering 0 hosts >2012-12-23 11:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Checking autorecoverable hosts done >2012-12-23 11:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-49) Autorecovering storage domains is disabled, skipping >2012-12-23 11:29:59,999 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-12-23 11:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-12-23 11:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-12-23 11:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering storage domains is disabled, skipping >2012-12-23 11:34:27,496 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-48) VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 moved from Up --> RebootInProgress >2012-12-23 11:34:27,497 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[22ee2cb6-d617-44ce-b650-d16607825589]), log id: 3a435d74 >2012-12-23 11:34:27,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1cac888e, log id: 3a435d74 >2012-12-23 11:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts >2012-12-23 11:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering 0 hosts >2012-12-23 11:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Checking autorecoverable hosts done >2012-12-23 11:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-58) Autorecovering storage domains is disabled, skipping >2012-12-23 11:35:24,421 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 moved from RebootInProgress --> Up >2012-12-23 11:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts >2012-12-23 11:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering 0 hosts >2012-12-23 11:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Checking autorecoverable hosts done >2012-12-23 11:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) Autorecovering storage domains is disabled, skipping >2012-12-23 11:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts >2012-12-23 11:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering 0 hosts >2012-12-23 11:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts done >2012-12-23 11:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering storage domains is disabled, skipping >2012-12-23 11:47:45,235 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-29) [512ffd55] DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 11:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-12-23 11:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-12-23 11:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-12-23 11:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains is disabled, skipping >2012-12-23 11:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts >2012-12-23 11:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering 0 hosts >2012-12-23 11:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Checking autorecoverable hosts done >2012-12-23 11:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-46) Autorecovering storage domains is disabled, skipping >2012-12-23 12:00:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts >2012-12-23 12:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering 0 hosts >2012-12-23 12:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Checking autorecoverable hosts done >2012-12-23 12:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-10) Autorecovering storage domains is disabled, skipping >2012-12-23 12:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts >2012-12-23 12:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering 0 hosts >2012-12-23 12:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts done >2012-12-23 12:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering storage domains is disabled, skipping >2012-12-23 12:06:35,532 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) [3508e8f9] VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from Up --> RebootInProgress >2012-12-23 12:06:35,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-6) [3508e8f9] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: e258e4c >2012-12-23 12:06:35,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-6) [3508e8f9] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@43a126d5, log id: e258e4c >2012-12-23 12:07:24,364 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from RebootInProgress --> Up >2012-12-23 12:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Checking autorecoverable hosts >2012-12-23 12:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Autorecovering 0 hosts >2012-12-23 12:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Checking autorecoverable hosts done >2012-12-23 12:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2a7e5e42] Autorecovering storage domains is disabled, skipping >2012-12-23 12:11:18,130 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-27) [ad2fff] VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from Up --> RebootInProgress >2012-12-23 12:12:11,553 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from RebootInProgress --> Up >2012-12-23 12:15:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts >2012-12-23 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering 0 hosts >2012-12-23 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Checking autorecoverable hosts done >2012-12-23 12:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-47) Autorecovering storage domains is disabled, skipping >2012-12-23 12:18:00,407 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-10) [7f665cc4] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:18:00,410 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [7f665cc4] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=2u8lo+FLOeH8, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 70c80a72 >2012-12-23 12:18:00,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-10) [7f665cc4] FINISH, SetVmTicketVDSCommand, log id: 70c80a72 >2012-12-23 12:18:09,830 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-4) [721d3d84] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:18:09,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [721d3d84] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, ticket=J1bXLMmgKbh5, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4eb00f3b >2012-12-23 12:18:09,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [721d3d84] FINISH, SetVmTicketVDSCommand, log id: 4eb00f3b >2012-12-23 12:18:17,922 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-6) [1515b802] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 12:18:17,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [1515b802] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, ticket=98pwsGwriqy+, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 55890fff >2012-12-23 12:18:18,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-6) [1515b802] FINISH, SetVmTicketVDSCommand, log id: 55890fff >2012-12-23 12:18:33,538 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-4) [65efab45] Running command: SetVmTicketCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:18:33,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [65efab45] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, ticket=sfjKEsTKYPhd, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7b372eec >2012-12-23 12:18:33,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-4) [65efab45] FINISH, SetVmTicketVDSCommand, log id: 7b372eec >2012-12-23 12:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [15a44b8e] Checking autorecoverable hosts >2012-12-23 12:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [15a44b8e] Autorecovering 0 hosts >2012-12-23 12:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [15a44b8e] Checking autorecoverable hosts done >2012-12-23 12:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [15a44b8e] Autorecovering storage domains is disabled, skipping >2012-12-23 12:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts >2012-12-23 12:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering 0 hosts >2012-12-23 12:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Checking autorecoverable hosts done >2012-12-23 12:25:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [72ce052a] Autorecovering storage domains is disabled, skipping >2012-12-23 12:27:59,095 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-5) [3b9f1514] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:27:59,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [3b9f1514] START, SetVmTicketVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=/lOHa4S73a5Z, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4d82f5b5 >2012-12-23 12:27:59,205 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-5) [3b9f1514] FINISH, SetVmTicketVDSCommand, log id: 4d82f5b5 >2012-12-23 12:28:27,655 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) Start time: 12/23/12 12:28 PM. Start running CanDoAction for command number 1/2 (Command type: MigrateVm) >2012-12-23 12:28:27,655 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) Start time: 12/23/12 12:28 PM. Start running CanDoAction for command number 2/2 (Command type: MigrateVm) >2012-12-23 12:28:27,673 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-46) End time: 12/23/12 12:28 PM. Finish handling CanDoAction for command number 2/2 (Command type: MigrateVm) >2012-12-23 12:28:27,714 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-45) End time: 12/23/12 12:28 PM. Finish handling CanDoAction for command number 1/2 (Command type: MigrateVm) >2012-12-23 12:28:27,779 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-45) [702c410c] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:28:27,794 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [702c410c] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: d6aeaff >2012-12-23 12:28:27,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [702c410c] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:27,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [702c410c] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 79123bbc >2012-12-23 12:28:27,815 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [702c410c] FINISH, MigrateBrokerVDSCommand, log id: 79123bbc >2012-12-23 12:28:28,048 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [702c410c] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: d6aeaff >2012-12-23 12:28:28,200 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-45) [6ef27d5b] Running command: MigrateVmCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 12:28:28,209 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [6ef27d5b] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 65c0252f >2012-12-23 12:28:28,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [6ef27d5b] VdsBroker::migrate::Entered (vm_guid=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:28,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [6ef27d5b] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 58398077 >2012-12-23 12:28:28,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-45) [6ef27d5b] FINISH, MigrateBrokerVDSCommand, log id: 58398077 >2012-12-23 12:28:28,245 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-45) [6ef27d5b] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 65c0252f >2012-12-23 12:28:29,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, 22ee2cb6-d617-44ce-b650-d16607825589]), log id: 211f1b2f >2012-12-23 12:28:29,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-48) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@131bba6, log id: 211f1b2f >2012-12-23 12:28:29,613 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:29,614 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:31,886 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:31,887 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:34,730 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-32) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:34,731 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-32) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:36,797 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-66) [5f7c22ad] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:36,798 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-66) [5f7c22ad] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:38,861 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-33) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:38,862 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-33) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:40,928 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:40,928 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:42,993 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:42,993 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:45,349 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:45,349 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-94) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:28:46,645 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-98) START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 6317e66a >2012-12-23 12:28:46,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-98) FINISH, DestroyVDSCommand, log id: 6317e66a >2012-12-23 12:28:46,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-98) START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, force=false, secondsToWait=0, gracefully=false), log id: 441c6362 >2012-12-23 12:28:46,867 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-98) FINISH, DestroyVDSCommand, log id: 441c6362 >2012-12-23 12:28:46,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) Setting VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 to status unknown >2012-12-23 12:28:46,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) vm vm4 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 12:28:46,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) Setting VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 to status unknown >2012-12-23 12:28:46,871 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-98) vm vm3 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 12:28:46,947 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-41) [13e97b24] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, 22ee2cb6-d617-44ce-b650-d16607825589]), log id: 24913b58 >2012-12-23 12:28:46,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-41) [13e97b24] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@3acf2129, log id: 24913b58 >2012-12-23 12:28:57,994 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (pool-3-thread-50) [253097f4] Running command: MaintananceNumberOfVdssCommand internal: false. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 12:28:58,000 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-50) [253097f4] START, SetVdsStatusVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 2153c905 >2012-12-23 12:28:58,047 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-50) [253097f4] FINISH, SetVdsStatusVDSCommand, log id: 2153c905 >2012-12-23 12:28:58,199 INFO [org.ovirt.engine.core.bll.MaintananceVdsCommand] (pool-3-thread-50) [253097f4] Running command: MaintananceVdsCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 12:28:58,279 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-50) [6456f9e] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:28:58,287 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [6456f9e] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 42051811 >2012-12-23 12:28:58,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6456f9e] VdsBroker::migrate::Entered (vm_guid=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:58,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6456f9e] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 7583947e >2012-12-23 12:28:58,308 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6456f9e] FINISH, MigrateBrokerVDSCommand, log id: 7583947e >2012-12-23 12:28:58,342 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [6456f9e] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 42051811 >2012-12-23 12:28:58,431 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-50) [6890e08b] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:28:58,441 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [6890e08b] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 2f4923d1 >2012-12-23 12:28:58,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6890e08b] VdsBroker::migrate::Entered (vm_guid=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:58,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6890e08b] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 27c9b4bf >2012-12-23 12:28:58,461 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [6890e08b] FINISH, MigrateBrokerVDSCommand, log id: 27c9b4bf >2012-12-23 12:28:58,500 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [6890e08b] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 2f4923d1 >2012-12-23 12:28:58,674 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-50) [5bcbd71c] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:28:58,683 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [5bcbd71c] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 2f33f301 >2012-12-23 12:28:58,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5bcbd71c] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:58,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5bcbd71c] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 45118d2 >2012-12-23 12:28:58,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5bcbd71c] FINISH, MigrateBrokerVDSCommand, log id: 45118d2 >2012-12-23 12:28:58,748 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [5bcbd71c] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 2f33f301 >2012-12-23 12:28:58,936 INFO [org.ovirt.engine.core.bll.InternalMigrateVmCommand] (pool-3-thread-50) [529e7e59] Running command: InternalMigrateVmCommand internal: true. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 12:28:58,945 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [529e7e59] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 5d4cedb4 >2012-12-23 12:28:58,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [529e7e59] VdsBroker::migrate::Entered (vm_guid=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 12:28:58,946 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [529e7e59] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 180fee52 >2012-12-23 12:28:58,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [529e7e59] FINISH, MigrateBrokerVDSCommand, log id: 180fee52 >2012-12-23 12:28:58,982 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [529e7e59] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5d4cedb4 >2012-12-23 12:28:59,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-82) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:28:59,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-82) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:02,036 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:02,037 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:02,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-70) START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65, 2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 7e80dbbb >2012-12-23 12:29:02,906 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-70) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@611f115d, log id: 7e80dbbb >2012-12-23 12:29:05,008 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:05,009 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:07,097 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:07,098 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:09,163 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [4be06a77] vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:09,164 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [4be06a77] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:11,231 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) [3508e8f9] vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:11,232 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) [3508e8f9] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:13,285 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:13,286 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:15,741 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:15,741 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-96) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:17,868 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:17,872 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:17,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-93) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 22e7bd79 >2012-12-23 12:29:17,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-93) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1c4864d6, log id: 22e7bd79 >2012-12-23 12:29:18,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-38) START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, force=false, secondsToWait=0, gracefully=false), log id: 265d96bb >2012-12-23 12:29:18,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-38) FINISH, DestroyVDSCommand, log id: 265d96bb >2012-12-23 12:29:18,335 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) Setting VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 to status unknown >2012-12-23 12:29:18,335 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vm vm1 running in db and not running in vds - add to rerun treatment. vds orchid-vds2 >2012-12-23 12:29:18,974 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) [2ad05129] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:18,975 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) [2ad05129] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:18,975 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) [2ad05129] VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from Unknown --> Up >2012-12-23 12:29:18,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) [2ad05129] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65, 2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 287d0794 >2012-12-23 12:29:19,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) [2ad05129] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@287c9a50, log id: 287d0794 >2012-12-23 12:29:20,956 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-83) [3707f39] START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 37cb834a >2012-12-23 12:29:21,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-83) [3707f39] FINISH, DestroyVDSCommand, log id: 37cb834a >2012-12-23 12:29:21,068 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) [3707f39] Setting VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 to status unknown >2012-12-23 12:29:21,068 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) [3707f39] vm vm2 running in db and not running in vds - add to rerun treatment. vds orchid-vds2 >2012-12-23 12:29:21,857 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:21,858 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:21,860 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-55) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from Unknown --> Up >2012-12-23 12:29:21,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-55) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 6bbf6575 >2012-12-23 12:29:21,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-55) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@629e1b96, log id: 6bbf6575 >2012-12-23 12:29:22,172 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:22,173 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:24,509 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:24,510 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:26,600 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:26,601 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-76) [947a8e6] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:28,670 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:28,671 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:29,975 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-46) [2d43ecee] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:29:29,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [2d43ecee] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=8e9a5d4a-2dcd-40f7-b963-5ba7350acd25, networkName=rhevm, speed=1000, type=3, name=mgmt, macAddress=00:1a:4a:16:88:58, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=8e9a5d4a-2dcd-40f7-b963-5ba7350acd25, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 3294db21 >2012-12-23 12:29:30,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [2d43ecee] FINISH, HotUnplugNicVDSCommand, log id: 3294db21 >2012-12-23 12:29:30,772 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:30,773 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:32,839 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:32,840 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:35,549 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-79) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 12:29:35,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-79) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[22ee2cb6-d617-44ce-b650-d16607825589]), log id: 3dcbd2db >2012-12-23 12:29:35,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-79) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1080478f, log id: 3dcbd2db >2012-12-23 12:29:37,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-31) START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 76053574 >2012-12-23 12:29:37,659 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-31) FINISH, DestroyVDSCommand, log id: 76053574 >2012-12-23 12:29:37,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-31) START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, force=false, secondsToWait=0, gracefully=false), log id: 240f70ee >2012-12-23 12:29:37,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-31) FINISH, DestroyVDSCommand, log id: 240f70ee >2012-12-23 12:29:37,769 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 status = Down on vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 12:29:37,769 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) Setting VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 to status unknown >2012-12-23 12:29:37,770 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-31) vm vm4 running in db and not running in vds - add to rerun treatment. vds orchid-vds2 >2012-12-23 12:29:37,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-53) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 6da9efd7 >2012-12-23 12:29:37,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-53) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4a24240b, log id: 6da9efd7 >2012-12-23 12:29:38,707 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-46) [32a329dd] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:29:38,711 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) [32a329dd] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:58) - entered >2012-12-23 12:29:39,922 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-77) [45535bf3] vds::Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2 >2012-12-23 12:29:39,997 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [45535bf3] Clearing cache of pool: 4027fdea-c811-4bf2-b779-25dbdcacbea5 for problematic entities of VDS: orchid-vds2. >2012-12-23 12:29:40,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-77) [45535bf3] START, DisconnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2), log id: 316e92e2 >2012-12-23 12:29:44,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStoragePoolVDSCommand] (QuartzScheduler_Worker-77) [45535bf3] FINISH, DisconnectStoragePoolVDSCommand, log id: 316e92e2 >2012-12-23 12:29:44,029 INFO [org.ovirt.engine.core.bll.storage.DisconnectHostFromStoragePoolServersCommand] (QuartzScheduler_Worker-77) [54de5d37] Running command: DisconnectHostFromStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 12:29:44,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-77) [54de5d37] START, DisconnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2ebb2125 >2012-12-23 12:29:47,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DisconnectStorageServerVDSCommand] (QuartzScheduler_Worker-77) [54de5d37] FINISH, DisconnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 2ebb2125 >2012-12-23 12:29:47,817 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-3) [649722fe] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 12:29:47,818 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-3) [649722fe] MacPoolManager::allocateNewMac entered >2012-12-23 12:29:47,818 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-3) [649722fe] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:58 >2012-12-23 12:29:47,928 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-3) [6685a834] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:29:47,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [6685a834] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=4be7f699-3e82-40ae-aa04-1a98aa40612c, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:58, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=4be7f699-3e82-40ae-aa04-1a98aa40612c, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 44219c4c >2012-12-23 12:29:48,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [6685a834] FINISH, HotPlugNicVDSCommand, log id: 44219c4c >2012-12-23 12:29:51,247 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [51a4ef8f] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:29:51,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [51a4ef8f] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm2, nic=VmNetworkInterface {id=e1998bdb-c4cc-47a4-820a-27357eeb5160, networkName=rhevm, speed=1000, type=3, name=mgmt, macAddress=00:1a:4a:16:88:55, active=true, portMirroring=false, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vmName=vm2, vmTemplateId=null}, vmDevice=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=e1998bdb-c4cc-47a4-820a-27357eeb5160, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 3c5b50db >2012-12-23 12:29:51,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [51a4ef8f] FINISH, HotUnplugNicVDSCommand, log id: 3c5b50db >2012-12-23 12:29:52,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-58) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 25241d75 >2012-12-23 12:29:52,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-58) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6609ff5f, log id: 25241d75 >2012-12-23 12:29:57,396 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-50) [2d098907] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:29:57,401 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [2d098907] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:55) - entered >2012-12-23 12:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts >2012-12-23 12:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering 0 hosts >2012-12-23 12:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Checking autorecoverable hosts done >2012-12-23 12:30:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-22) Autorecovering storage domains is disabled, skipping >2012-12-23 12:30:03,784 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [78b553bd] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 12:30:03,785 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-7) [78b553bd] MacPoolManager::allocateNewMac entered >2012-12-23 12:30:03,785 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-7) [78b553bd] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:55 >2012-12-23 12:30:03,905 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-7) [29fe364b] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:30:03,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-7) [29fe364b] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm2, nic=VmNetworkInterface {id=709101ea-97fc-4ea3-ac6d-4284e4e973bc, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:55, active=true, portMirroring=true, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vmName=vm2, vmTemplateId=null}, vmDevice=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=709101ea-97fc-4ea3-ac6d-4284e4e973bc, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 2114691d >2012-12-23 12:30:04,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-7) [29fe364b] FINISH, HotPlugNicVDSCommand, log id: 2114691d >2012-12-23 12:30:08,651 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [2424ef4f] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:30:08,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2424ef4f] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm4, nic=VmNetworkInterface {id=6ae7f728-924d-44ce-8dfe-dde5edcc7554, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:52, active=true, portMirroring=true, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vmName=vm4, vmTemplateId=null}, vmDevice=VmDevice {vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, deviceId=6ae7f728-924d-44ce-8dfe-dde5edcc7554, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 1d5ee1b8 >2012-12-23 12:30:08,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2424ef4f] FINISH, HotUnplugNicVDSCommand, log id: 1d5ee1b8 >2012-12-23 12:30:13,278 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-46) [317d3a3] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:30:13,280 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) [317d3a3] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:52) - entered >2012-12-23 12:30:14,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) [2ad05129] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 46022e89 >2012-12-23 12:30:14,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-40) [2ad05129] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@393d4847, log id: 46022e89 >2012-12-23 12:30:17,328 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [4d2e57b] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:30:17,329 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-10) [4d2e57b] MacPoolManager::allocateNewMac entered >2012-12-23 12:30:17,329 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-10) [4d2e57b] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:52 >2012-12-23 12:30:17,669 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [599aa4ac] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 12:30:17,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [599aa4ac] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm4, nic=VmNetworkInterface {id=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:52, active=true, portMirroring=false, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vmName=vm4, vmTemplateId=null}, vmDevice=VmDevice {vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, deviceId=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 12b93f6a >2012-12-23 12:30:18,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [599aa4ac] FINISH, HotPlugNicVDSCommand, log id: 12b93f6a >2012-12-23 12:30:43,747 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-8) [68c680d] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 12:30:43,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [68c680d] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=pl6myUCB+Frs, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 4ed818d2 >2012-12-23 12:30:43,851 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-8) [68c680d] FINISH, SetVmTicketVDSCommand, log id: 4ed818d2 >2012-12-23 12:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Checking autorecoverable hosts >2012-12-23 12:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Autorecovering 0 hosts >2012-12-23 12:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Checking autorecoverable hosts done >2012-12-23 12:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [3c7b1ec5] Autorecovering storage domains is disabled, skipping >2012-12-23 12:40:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts >2012-12-23 12:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering 0 hosts >2012-12-23 12:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Checking autorecoverable hosts done >2012-12-23 12:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) [ad2fff] Autorecovering storage domains is disabled, skipping >2012-12-23 12:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts >2012-12-23 12:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering 0 hosts >2012-12-23 12:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Checking autorecoverable hosts done >2012-12-23 12:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-48) Autorecovering storage domains is disabled, skipping >2012-12-23 12:47:45,235 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-72) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 12:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts >2012-12-23 12:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering 0 hosts >2012-12-23 12:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Checking autorecoverable hosts done >2012-12-23 12:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-4) Autorecovering storage domains is disabled, skipping >2012-12-23 12:51:20,980 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [28b993b4] Running command: StopVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 12:51:20,982 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [28b993b4] START, DestroyVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 199ae3ab >2012-12-23 12:51:20,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [28b993b4] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 14d9196e >2012-12-23 12:51:21,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [28b993b4] FINISH, DestroyVDSCommand, log id: 14d9196e >2012-12-23 12:51:21,759 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [28b993b4] FINISH, DestroyVmVDSCommand, return: Down, log id: 199ae3ab >2012-12-23 12:52:44,416 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 43429ca7 >2012-12-23 12:52:44,417 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-50) FINISH, IsValidVDSCommand, return: true, log id: 43429ca7 >2012-12-23 12:52:44,417 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-50) START, GetIsoListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4414c4d2 >2012-12-23 12:52:44,418 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3e007b33 >2012-12-23 12:52:44,420 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-46) FINISH, IsValidVDSCommand, return: true, log id: 3e007b33 >2012-12-23 12:52:44,420 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-46) START, GetFloppyListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 3b1bf94 >2012-12-23 12:52:44,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-50) START, HsmGetIsoListVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId=4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 9854c14 >2012-12-23 12:52:44,498 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-50) FINISH, HsmGetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 9854c14 >2012-12-23 12:52:44,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-50) FINISH, GetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 4414c4d2 >2012-12-23 12:52:44,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-46) FINISH, GetFloppyListVDSCommand, return: [win7-64.vfd, win2003-x64-unattended.vfd, win2k8-R2.vfd, win7x64_with_virtio.vfd, win7-32.vfd, win2k3-64-with-virtio.vfd, win2003-32-unattended.vfd, win2000-Pro-unattended.vfd, win2k3-32-with-virtio.vfd, win2k8-32_with_virtio.vfd, virtio-drivers-1.0.0-45801.vfd, win2k3.vfd, winxp.vfd, win2k3x64.vfd, virtio-win-1.4.0.vfd, winXP-Pro-SP2-32-unattended.vfd, virtio-drivers.vfd, virtio-win-1.1.16.vfd, winXP-x64-unattended.vfd, win7-32_with_virtio.vfd, winxp_32_virtio.vfd, virtio-drivers-1.0.0-8.vfd, win2k8-R2_with_virtio.vfd], log id: 3b1bf94 >2012-12-23 12:52:44,758 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-3-thread-50) Finished automatic refresh process for ISO file type with success, for storage domain id 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6. >2012-12-23 12:52:44,798 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-3-thread-46) Finished automatic refresh process for Floppy file type with success, for storage domain id 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6. >2012-12-23 12:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-12-23 12:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-12-23 12:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-12-23 12:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains is disabled, skipping >2012-12-23 13:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts >2012-12-23 13:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering 0 hosts >2012-12-23 13:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Checking autorecoverable hosts done >2012-12-23 13:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-89) Autorecovering storage domains is disabled, skipping >2012-12-23 13:01:28,419 INFO [org.ovirt.engine.core.bll.SetupNetworksCommand] (ajp-/127.0.0.1:8702-4) [3c121e9a] Running command: SetupNetworksCommand internal: false. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 13:01:28,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp-/127.0.0.1:8702-4) [3c121e9a] START, SetupNetworksVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[vmnet1 {id=8de6a98d-d353-49ed-8dd3-cae1d54c84c1, description=null, subnet=null, gateway=null, type=null, vlan_id=null, stp=false, storage_pool_id=4027fdea-c811-4bf2-b779-25dbdcacbea5, mtu=0, vmNetwork=true, cluster=network_cluster {id={clusterId=null, networkId=null}, status=Operational, is_display=false, required=false}}], > bonds=[], > interfaces=[eth3 {id=92a31120-b5a4-407e-928d-ad700cefbbe6, vdsId=1ea924d8-49a9-11e2-bbf4-001122334455, name=eth3, macAddress=00:14:5E:17:D5:B2, networkName=vmnet1, bondName=null, bootProtocol=None, address=, subnet=, gateway=null, mtu=0, bridged=true, speed=1000, type=0, networkImplementationDetails=null}, > eth1 {id=0d461e09-333b-4795-85d0-a8e4eb71ff1c, vdsId=1ea924d8-49a9-11e2-bbf4-001122334455, name=eth1, macAddress=00:15:17:3D:CD:AB, networkName=null, bondName=null, bootProtocol=None, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, > eth2 {id=887159a0-3b81-4973-9b0e-3cc2f72f174d, vdsId=1ea924d8-49a9-11e2-bbf4-001122334455, name=eth2, macAddress=00:14:5E:17:D5:B0, networkName=null, bondName=null, bootProtocol=None, address=, subnet=, gateway=null, mtu=1500, bridged=false, speed=1000, type=0, networkImplementationDetails=null}, > eth0 {id=37e66721-ac47-45a3-8fd7-0efc3ed6c92c, vdsId=1ea924d8-49a9-11e2-bbf4-001122334455, name=eth0, macAddress=00:15:17:3D:CD:AA, networkName=rhevm, bondName=null, bootProtocol=StaticIp, address=10.35.97.58, subnet=255.255.255.0, gateway=10.35.97.254, mtu=1500, bridged=true, speed=1000, type=2, networkImplementationDetails={inSync=true, managed=true}}], > removedNetworks=[], > removedBonds=[]), log id: 352b37c0 >2012-12-23 13:01:28,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (ajp-/127.0.0.1:8702-4) [3c121e9a] FINISH, SetupNetworksVDSCommand, log id: 352b37c0 >2012-12-23 13:01:31,266 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (ajp-/127.0.0.1:8702-4) [3c121e9a] START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@2468b101), log id: 5295dd4d >2012-12-23 13:01:31,267 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (ajp-/127.0.0.1:8702-4) [3c121e9a] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 5295dd4d >2012-12-23 13:01:31,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [3c121e9a] No string for UNASSIGNED type. Use default Log >2012-12-23 13:01:50,132 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [3dc3e70a] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:01:50,135 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-10) [3dc3e70a] MacPoolManager::allocateNewMac entered >2012-12-23 13:01:50,246 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-10) [3dc3e70a] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:5a >2012-12-23 13:01:50,353 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [1eb9516a] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:01:50,355 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [1eb9516a] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=d9a24fb0-706a-474c-bfd5-65e0e9f4e380, networkName=vmnet1, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:5a, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=d9a24fb0-706a-474c-bfd5-65e0e9f4e380, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 131cda40 >2012-12-23 13:01:50,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [1eb9516a] FINISH, HotPlugNicVDSCommand, log id: 131cda40 >2012-12-23 13:01:51,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 3bab4c99 >2012-12-23 13:01:51,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6b31ef69, log id: 3bab4c99 >2012-12-23 13:04:18,589 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-46) [1f8be134] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:04:18,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [1f8be134] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=d9a24fb0-706a-474c-bfd5-65e0e9f4e380, networkName=vmnet1, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:5a, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=d9a24fb0-706a-474c-bfd5-65e0e9f4e380, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x07, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net1}), log id: 9f5f2d8 >2012-12-23 13:04:18,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [1f8be134] FINISH, HotUnplugNicVDSCommand, log id: 9f5f2d8 >2012-12-23 13:04:23,519 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-50) [5e2ff657] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:04:23,526 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [5e2ff657] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:5a) - entered >2012-12-23 13:04:27,188 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-4) Lock Acquired to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >, sharedLocks= ] >2012-12-23 13:04:27,196 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-4) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 24e44404 >2012-12-23 13:04:27,197 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, IsValidVDSCommand, return: true, log id: 24e44404 >2012-12-23 13:04:27,254 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) START, IsVmDuringInitiatingVDSCommand( vmId = 2e79d247-3ef0-4fc5-b865-ed1092c89a89), log id: 6f480df0 >2012-12-23 13:04:27,254 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 6f480df0 >2012-12-23 13:04:27,355 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [3e0155b2] Running command: RunVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:04:27,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (pool-3-thread-50) [3e0155b2] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5d2186b2 >2012-12-23 13:04:27,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (pool-3-thread-50) [3e0155b2] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 5d2186b2 >2012-12-23 13:04:27,406 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [3e0155b2] START, CreateVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@7edbffbd), log id: 44123fe2 >2012-12-23 13:04:27,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [3e0155b2] START, CreateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@7edbffbd), log id: 70deabb6 >2012-12-23 13:04:27,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [3e0155b2] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89,devices=[Ljava.util.Map;@6cd4da3,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={} >2012-12-23 13:04:27,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-50) [3e0155b2] FINISH, CreateVDSCommand, log id: 70deabb6 >2012-12-23 13:04:27,582 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [3e0155b2] IncreasePendingVms::CreateVmIncreasing vds orchid-vds1 pending vcpu count, now 1. Vm: vm2 >2012-12-23 13:04:27,615 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-50) [3e0155b2] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 44123fe2 >2012-12-23 13:04:27,615 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-50) [3e0155b2] Lock freed to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >, sharedLocks= ] >2012-12-23 13:04:31,586 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from WaitForLaunch --> PoweringUp >2012-12-23 13:04:31,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-88) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 42eee70b >2012-12-23 13:04:31,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-88) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5282a581, log id: 42eee70b >2012-12-23 13:04:37,859 INFO [org.ovirt.engine.core.bll.StopVmCommand] (pool-3-thread-50) [4ddf0df9] Running command: StopVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:04:37,862 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [4ddf0df9] START, DestroyVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 35cb5747 >2012-12-23 13:04:38,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [4ddf0df9] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 16f1cdbf >2012-12-23 13:04:38,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (pool-3-thread-50) [4ddf0df9] FINISH, DestroyVDSCommand, log id: 16f1cdbf >2012-12-23 13:04:38,732 INFO [org.ovirt.engine.core.vdsbroker.DestroyVmVDSCommand] (pool-3-thread-50) [4ddf0df9] FINISH, DestroyVmVDSCommand, return: Down, log id: 35cb5747 >2012-12-23 13:04:41,047 WARN [org.ovirt.engine.core.bll.StopVmCommand] (ajp-/127.0.0.1:8702-2) CanDoAction of action StopVm failed. Reasons:ACTION_TYPE_FAILED_VM_IS_NOT_RUNNING,VAR__ACTION__STOP,VAR__TYPE__VM >2012-12-23 13:04:50,561 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] Lock Acquired to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2012-12-23 13:04:50,572 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-10) Unable to get value of property: isQuotaDefault for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-12-23 13:04:50,572 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-10) Unable to get value of property: isQuotaDefault for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-12-23 13:04:50,572 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-10) Unable to get value of property: managedDeviceMap for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-12-23 13:04:50,573 WARN [org.ovirt.engine.core.compat.backendcompat.PropertyInfo] (ajp-/127.0.0.1:8702-10) Unable to get value of property: managedDeviceMap for class org.ovirt.engine.core.common.businessentities.VmStatic >2012-12-23 13:04:50,594 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] Running command: UpdateVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:04:50,612 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1cdbc6b6 >2012-12-23 13:04:50,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] FINISH, IsValidVDSCommand, return: true, log id: 1cdbc6b6 >2012-12-23 13:04:50,639 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 35596bcb >2012-12-23 13:04:50,826 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] FINISH, UpdateVMVDSCommand, log id: 35596bcb >2012-12-23 13:04:50,856 INFO [org.ovirt.engine.core.bll.UpdateVmCommand] (ajp-/127.0.0.1:8702-10) [61c95bf] Lock freed to object EngineLock [exclusiveLocks= key: vm2 value: VM_NAME >, sharedLocks= ] >2012-12-23 13:04:53,244 INFO [org.ovirt.engine.core.bll.RunVmCommand] (ajp-/127.0.0.1:8702-5) Lock Acquired to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >, sharedLocks= ] >2012-12-23 13:04:53,248 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-5) START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6a92b7f7 >2012-12-23 13:04:53,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, IsValidVDSCommand, return: true, log id: 6a92b7f7 >2012-12-23 13:04:53,294 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) START, IsVmDuringInitiatingVDSCommand( vmId = 2e79d247-3ef0-4fc5-b865-ed1092c89a89), log id: 398c4f5a >2012-12-23 13:04:53,294 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 398c4f5a >2012-12-23 13:04:53,356 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [b323856] Running command: RunVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:04:53,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (pool-3-thread-46) [b323856] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19b0c55b >2012-12-23 13:04:53,396 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (pool-3-thread-46) [b323856] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 19b0c55b >2012-12-23 13:04:53,397 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [b323856] START, CreateVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@389b659b), log id: 246ce68a >2012-12-23 13:04:53,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [b323856] START, CreateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vm=org.ovirt.engine.core.common.businessentities.VM@389b659b), log id: 2208937f >2012-12-23 13:04:53,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [b323856] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=2048,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=0,transparentHugePages=true,vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89,devices=[Ljava.util.Map;@37a27c2c,acpiEnable=true,vmName=vm2,cpuType=Conroe,custom={device_f9131c5b-522f-43c4-976f-27bdde275228device_f473ddb4-d244-4703-bbae-9abde8f6abb2=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=f473ddb4-d244-4703-bbae-9abde8f6abb2, device=virtio-serial, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x04, function=0x0}, managed=false, plugged=true, readOnly=false, alias=virtio-serial0}, device_f9131c5b-522f-43c4-976f-27bdde275228device_f473ddb4-d244-4703-bbae-9abde8f6abb2device_d305c20e-3c67-476b-b40f-92726a46bd3edevice_872a151b-f268-4423-9e33-e7c2753b62c4device_fd3efcfa-d9d0-4bcf-8ae4-1e9cf83b0a08=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=fd3efcfa-d9d0-4bcf-8ae4-1e9cf83b0a08, device=spicevmc, type=channel, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel2}, device_f9131c5b-522f-43c4-976f-27bdde275228device_f473ddb4-d244-4703-bbae-9abde8f6abb2device_d305c20e-3c67-476b-b40f-92726a46bd3e=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=d305c20e-3c67-476b-b40f-92726a46bd3e, device=unix, type=channel, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel0}, device_f9131c5b-522f-43c4-976f-27bdde275228=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=f9131c5b-522f-43c4-976f-27bdde275228, device=ide, type=controller, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, alias=ide0}, device_f9131c5b-522f-43c4-976f-27bdde275228device_f473ddb4-d244-4703-bbae-9abde8f6abb2device_d305c20e-3c67-476b-b40f-92726a46bd3edevice_872a151b-f268-4423-9e33-e7c2753b62c4=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=872a151b-f268-4423-9e33-e7c2753b62c4, device=unix, type=channel, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, alias=channel1}} >2012-12-23 13:04:53,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (pool-3-thread-46) [b323856] FINISH, CreateVDSCommand, log id: 2208937f >2012-12-23 13:04:53,464 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [b323856] IncreasePendingVms::CreateVmIncreasing vds orchid-vds1 pending vcpu count, now 1. Vm: vm2 >2012-12-23 13:04:53,485 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (pool-3-thread-46) [b323856] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 246ce68a >2012-12-23 13:04:53,486 INFO [org.ovirt.engine.core.bll.RunVmCommand] (pool-3-thread-46) [b323856] Lock freed to object EngineLock [exclusiveLocks= key: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 value: VM >, sharedLocks= ] >2012-12-23 13:04:56,560 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-97) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from WaitForLaunch --> PoweringUp >2012-12-23 13:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts >2012-12-23 13:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering 0 hosts >2012-12-23 13:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Checking autorecoverable hosts done >2012-12-23 13:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-1) Autorecovering storage domains is disabled, skipping >2012-12-23 13:05:05,905 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [460c1b43] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:05:05,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [460c1b43] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, ticket=A1K6lc9NjC3g, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 762857f2 >2012-12-23 13:05:06,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [460c1b43] FINISH, SetVmTicketVDSCommand, log id: 762857f2 >2012-12-23 13:05:55,487 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-100) VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 moved from PoweringUp --> Up >2012-12-23 13:05:55,515 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-100) START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@f4550fcd), log id: 43fd5e73 >2012-12-23 13:05:55,564 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-100) FINISH, UpdateVdsDynamicDataVDSCommand, log id: 43fd5e73 >2012-12-23 13:07:10,442 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-46) [80aa835] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:07:10,445 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [80aa835] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm2, nic=VmNetworkInterface {id=709101ea-97fc-4ea3-ac6d-4284e4e973bc, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:55, active=true, portMirroring=true, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vmName=vm2, vmTemplateId=null}, vmDevice=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=709101ea-97fc-4ea3-ac6d-4284e4e973bc, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 540ce5d2 >2012-12-23 13:07:10,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-46) [80aa835] FINISH, HotUnplugNicVDSCommand, log id: 540ce5d2 >2012-12-23 13:07:17,394 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-37) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 18509c21 >2012-12-23 13:07:17,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-37) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@543a46ff, log id: 18509c21 >2012-12-23 13:07:17,422 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) VM 2e79d247-3ef0-4fc5-b865-ed1092c89a89 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=709101ea-97fc-4ea3-ac6d-4284e4e973bc, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=false, readOnly=false, alias=net0} >2012-12-23 13:07:21,083 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-46) [26555185] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:07:21,095 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) [26555185] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:55) - entered >2012-12-23 13:07:30,465 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [22123ac1] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:07:30,466 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [22123ac1] MacPoolManager::allocateNewMac entered >2012-12-23 13:07:30,466 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [22123ac1] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:55 >2012-12-23 13:07:30,546 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [7b9dd0ce] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 13:07:30,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [7b9dd0ce] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm2, nic=VmNetworkInterface {id=06fc76bb-c131-4efa-9fd5-d1cf96c8a071, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:55, active=true, portMirroring=false, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, vmName=vm2, vmTemplateId=null}, vmDevice=VmDevice {vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, deviceId=06fc76bb-c131-4efa-9fd5-d1cf96c8a071, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 6b68cde9 >2012-12-23 13:07:30,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [7b9dd0ce] FINISH, HotPlugNicVDSCommand, log id: 6b68cde9 >2012-12-23 13:07:58,932 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (ajp-/127.0.0.1:8702-6) Lock Acquired to object EngineLock [exclusiveLocks= key: 2d10c76a-49a9-11e2-9ecf-001122334455 value: VDS >, sharedLocks= ] >2012-12-23 13:07:59,795 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-50) [702903b6] Running command: ActivateVdsCommand internal: false. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:07:59,800 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-50) [702903b6] START, SetVdsStatusVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, status=Unassigned, nonOperationalReason=NONE), log id: 1adfabca >2012-12-23 13:07:59,802 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-3-thread-50) [702903b6] FINISH, SetVdsStatusVDSCommand, log id: 1adfabca >2012-12-23 13:07:59,858 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-50) [702903b6] START, ActivateVdsVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455), log id: 2abbfbce >2012-12-23 13:08:00,238 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (pool-3-thread-50) [153e621d] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:08:00,240 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (pool-3-thread-50) [7edb277b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:08:00,242 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (pool-3-thread-50) [7edb277b] FINISH, ActivateVdsVDSCommand, log id: 2abbfbce >2012-12-23 13:08:00,323 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (pool-3-thread-50) [7edb277b] Lock freed to object EngineLock [exclusiveLocks= key: 2d10c76a-49a9-11e2-9ecf-001122334455 value: VDS >, sharedLocks= ] >2012-12-23 13:08:00,642 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-2) [1e712cfb] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 13:08:00,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 577a5b7e >2012-12-23 13:08:00,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 577a5b7e >2012-12-23 13:08:00,741 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-2) [29ebfabd] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:08:00,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33596b27 >2012-12-23 13:08:01,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 33596b27 >2012-12-23 13:08:01,023 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-2) [29ebfabd] Host orchid-vds2 storage connection was succeeded >2012-12-23 13:08:01,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 75993456 >2012-12-23 13:08:04,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-2) [29ebfabd] FINISH, ConnectStoragePoolVDSCommand, log id: 75993456 >2012-12-23 13:08:04,657 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-2) [29ebfabd] No string for UNASSIGNED type. Use default Log >2012-12-23 13:08:04,659 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [29ebfabd] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 13:08:04,788 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-2) [7b455bc9] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:08:04,860 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [57696855] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts >2012-12-23 13:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 hosts >2012-12-23 13:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts done >2012-12-23 13:10:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering storage domains is disabled, skipping >2012-12-23 13:10:31,710 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-50) [2582d64a] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 13:10:31,720 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [2582d64a] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 968e737 >2012-12-23 13:10:31,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [2582d64a] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 13:10:31,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [2582d64a] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 48e7c26a >2012-12-23 13:10:31,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [2582d64a] FINISH, MigrateBrokerVDSCommand, log id: 48e7c26a >2012-12-23 13:10:31,758 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [2582d64a] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 968e737 >2012-12-23 13:10:33,519 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:35,596 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-88) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:37,641 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-4) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:39,708 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-74) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:41,757 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-84) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:44,778 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:46,833 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:48,882 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) [3707f39] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 13:10:50,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-39) START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: a9c6340 >2012-12-23 13:10:50,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-39) FINISH, DestroyVDSCommand, log id: a9c6340 >2012-12-23 13:10:50,610 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) Setting VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 to status unknown >2012-12-23 13:10:50,610 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) vm vm4 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 13:10:50,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 569c2573 >2012-12-23 13:10:50,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@255ecd71, log id: 569c2573 >2012-12-23 13:11:11,362 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-50) [5d508b0b] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 13:11:11,371 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [5d508b0b] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: cc7fd39 >2012-12-23 13:11:11,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5d508b0b] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 13:11:11,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5d508b0b] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 5e50264 >2012-12-23 13:11:11,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-50) [5d508b0b] FINISH, MigrateBrokerVDSCommand, log id: 5e50264 >2012-12-23 13:11:11,415 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-50) [5d508b0b] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: cc7fd39 >2012-12-23 13:11:13,234 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-56) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:15,324 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:17,392 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-86) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:19,560 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:21,604 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-82) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:23,660 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:25,706 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-22) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:27,775 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-20) vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 13:11:29,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-90) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 10821536 >2012-12-23 13:11:29,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-90) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4c3e94b1, log id: 10821536 >2012-12-23 13:11:30,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-50) START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 13c5057c >2012-12-23 13:11:30,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-50) FINISH, DestroyVDSCommand, log id: 13c5057c >2012-12-23 13:11:30,122 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-50) Setting VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 to status unknown >2012-12-23 13:11:30,122 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-50) vm vm4 running in db and not running in vds - add to rerun treatment. vds orchid-vds2 >2012-12-23 13:11:32,191 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-85) VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 moved from Unknown --> Up >2012-12-23 13:11:32,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-85) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 147dff4e >2012-12-23 13:11:32,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-85) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1a554cda, log id: 147dff4e >2012-12-23 13:11:41,018 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [4804ea2e] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:11:41,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [4804ea2e] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=4be7f699-3e82-40ae-aa04-1a98aa40612c, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:58, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=4be7f699-3e82-40ae-aa04-1a98aa40612c, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 1532e828 >2012-12-23 13:11:41,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [4804ea2e] FINISH, HotUnplugNicVDSCommand, log id: 1532e828 >2012-12-23 13:11:46,464 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-46) [6fe72163] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:11:46,466 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-46) [6fe72163] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:58) - entered >2012-12-23 13:11:46,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-66) [5f7c22ad] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 72acc7a7 >2012-12-23 13:11:46,745 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-66) [5f7c22ad] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2d67dfc2, log id: 72acc7a7 >2012-12-23 13:12:05,467 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-5) [1e6a6fef] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:12:05,572 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-5) [34684546] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:12:05,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-5) [34684546] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=cb219019-59cb-4035-ac1b-c9f90d01adfd, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=cb219019-59cb-4035-ac1b-c9f90d01adfd, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 55adecee >2012-12-23 13:12:05,905 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-5) [34684546] FINISH, HotPlugNicVDSCommand, log id: 55adecee >2012-12-23 13:12:07,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-21) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 4268978f >2012-12-23 13:12:07,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-21) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@60b64f58, log id: 4268978f >2012-12-23 13:12:21,120 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [3f762008] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:12:21,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [3f762008] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=cb219019-59cb-4035-ac1b-c9f90d01adfd, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=cb219019-59cb-4035-ac1b-c9f90d01adfd, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x08, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 6243e2f0 >2012-12-23 13:12:21,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [3f762008] FINISH, HotUnplugNicVDSCommand, log id: 6243e2f0 >2012-12-23 13:12:27,205 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [472a9638] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:12:27,210 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [472a9638] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 13:12:38,277 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [6f4b8222] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:12:38,365 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-7) [27014fb4] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:12:38,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-7) [27014fb4] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=b66af557-e23f-4637-941f-e400687ccf9a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=b66af557-e23f-4637-941f-e400687ccf9a, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 5bebb69b >2012-12-23 13:12:38,855 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-7) [27014fb4] FINISH, HotPlugNicVDSCommand, log id: 5bebb69b >2012-12-23 13:12:48,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 31cf8a1d >2012-12-23 13:12:48,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@30748f77, log id: 31cf8a1d >2012-12-23 13:13:02,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:13:02,643 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [35251df1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:13:02,745 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2012-12-23 13:13:02,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:02,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] Irs placed on server null failed. Proceed Failover >2012-12-23 13:13:02,779 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:02,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:02,807 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] SpmStatus on vds 1ea924d8-49a9-11e2-bbf4-001122334455: NULL >2012-12-23 13:13:02,809 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:02,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-21) [35251df1] START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 7705c46c >2012-12-23 13:13:02,816 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] XML RPC error in command HSMGetAllTasksStatusesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:02,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-21) [35251df1] SpmStopVDSCommand::Stopping SPM on vds orchid-vds1, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:02,822 WARN [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-21) [35251df1] could not stop spm of pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 on vds 1ea924d8-49a9-11e2-bbf4-001122334455 - reason: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:13:02,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-21) [35251df1] FINISH, SpmStopVDSCommand, log id: 7705c46c >2012-12-23 13:13:02,822 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:06,586 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [22ce8635] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:13:06,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [22ce8635] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=b66af557-e23f-4637-941f-e400687ccf9a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=b66af557-e23f-4637-941f-e400687ccf9a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x09, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 7e90c450 >2012-12-23 13:13:06,597 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-49) [22ce8635] Command HotUnplugNicVDS execution failed. Exception: XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:13:06,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [22ce8635] FINISH, HotUnplugNicVDSCommand, log id: 7e90c450 >2012-12-23 13:13:06,597 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [22ce8635] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:13:10,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command ListVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:10,133 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:12,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:12,145 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-9) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:12,847 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:12,869 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:13:12,871 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:12,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-82) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: c4cabd4 >2012-12-23 13:13:12,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-82) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:12,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-82) FINISH, SpmStopVDSCommand, log id: c4cabd4 >2012-12-23 13:13:12,873 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:14,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:14,163 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-70) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:16,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:13:16,181 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-60) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:18,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:18,196 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-88) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:20,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:20,208 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-4) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:22,219 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:22,219 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-6) [3508e8f9] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:22,916 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:22,918 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:13:22,920 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:22,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-68) [4be06a77] START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 781bed75 >2012-12-23 13:13:22,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-68) [4be06a77] SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:22,921 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-68) [4be06a77] FINISH, SpmStopVDSCommand, log id: 781bed75 >2012-12-23 13:13:22,921 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:24,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:24,231 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-62) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:26,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:26,243 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-84) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:28,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:28,254 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-99) [6d05d220] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:30,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:30,265 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-45) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:32,279 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:13:32,279 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:32,946 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:32,948 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:13:32,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:32,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-39) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: f7ea49e >2012-12-23 13:13:32,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-39) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:32,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-39) FINISH, SpmStopVDSCommand, log id: f7ea49e >2012-12-23 13:13:32,951 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:34,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [947a8e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:34,289 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-76) [947a8e6] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:36,300 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:36,300 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:38,319 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:38,319 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-66) [5f7c22ad] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:40,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:40,337 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-33) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:42,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:42,349 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-15) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:42,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:42,979 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:13:42,980 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:42,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 6b4bb656 >2012-12-23 13:13:42,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:42,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-97) FINISH, SpmStopVDSCommand, log id: 6b4bb656 >2012-12-23 13:13:42,981 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:44,364 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:44,364 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-31) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:46,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:46,375 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:48,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:48,389 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-64) [2d2ac2e6] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:50,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:50,400 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-41) [13e97b24] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:52,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [15499fea] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:52,412 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-81) [15499fea] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:13:53,008 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:13:53,011 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:13:53,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:13:53,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-47) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 64a83ab3 >2012-12-23 13:13:53,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-47) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:13:53,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-47) FINISH, SpmStopVDSCommand, log id: 64a83ab3 >2012-12-23 13:13:53,013 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) spm stop on spm failed, stopping spm selection! >2012-12-23 13:13:54,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:54,423 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-77) [54de5d37] VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 13:13:54,837 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-45) [54de5d37] ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 13:13:55,111 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-45) [6a54afdf] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 13:13:57,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:13:59,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:01,128 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:03,039 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:03,061 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:03,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:03,063 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:03,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:05,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:07,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:09,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:11,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:13,084 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:13,086 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:13,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:13,088 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:13,649 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:15,693 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:17,726 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:19,774 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:21,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:23,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:23,116 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:23,118 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:23,118 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:23,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:25,907 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:27,955 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:29,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:32,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:33,137 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-45) [7d0f4330] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:14:33,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-45) [7d0f4330] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=b66af557-e23f-4637-941f-e400687ccf9a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=b66af557-e23f-4637-941f-e400687ccf9a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x09, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 3a9f0b0f >2012-12-23 13:14:33,146 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-45) [7d0f4330] Command HotUnplugNicVDS execution failed. Exception: XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:14:33,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-45) [7d0f4330] FINISH, HotUnplugNicVDSCommand, log id: 3a9f0b0f >2012-12-23 13:14:33,146 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-45) [7d0f4330] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:14:33,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:33,163 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:33,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:33,164 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:34,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:36,878 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:38,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:41,005 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:43,064 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:43,190 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:43,192 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:43,194 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:43,194 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:45,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:47,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:49,449 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:51,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:53,219 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:14:53,221 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:14:53,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:14:53,223 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) spm vds is non responsive, stopping spm selection. >2012-12-23 13:14:53,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:55,950 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:14:58,005 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts >2012-12-23 13:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering 0 hosts >2012-12-23 13:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Checking autorecoverable hosts done >2012-12-23 13:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-60) Autorecovering storage domains is disabled, skipping >2012-12-23 13:15:00,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:02,095 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:03,247 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:03,250 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:03,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:03,251 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) spm vds is non responsive, stopping spm selection. >2012-12-23 13:15:04,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:06,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:08,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:10,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:11,861 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [76d67be2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:15:11,863 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [76d67be2] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=b66af557-e23f-4637-941f-e400687ccf9a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=b66af557-e23f-4637-941f-e400687ccf9a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x09, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 10cba79e >2012-12-23 13:15:11,869 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-49) [76d67be2] Command HotUnplugNicVDS execution failed. Exception: XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:15:11,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [76d67be2] FINISH, HotUnplugNicVDSCommand, log id: 10cba79e >2012-12-23 13:15:11,869 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [76d67be2] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:15:12,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:13,275 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:13,278 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:13,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:13,280 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) spm vds is non responsive, stopping spm selection. >2012-12-23 13:15:14,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:16,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:18,946 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [947a8e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:20,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:23,008 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:23,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:23,307 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:23,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:23,309 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] spm vds is non responsive, stopping spm selection. >2012-12-23 13:15:25,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:27,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:29,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:31,929 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:33,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:33,370 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:33,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:33,373 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] spm vds is non responsive, stopping spm selection. >2012-12-23 13:15:33,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:36,010 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:38,046 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:40,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:42,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:43,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:43,411 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:43,413 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:43,413 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) spm vds is non responsive, stopping spm selection. >2012-12-23 13:15:44,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [2aa79518] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:46,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:49,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:15:53,437 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:15:53,439 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:15:53,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:15:53,440 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:03,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:03,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:03,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:03,471 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:13,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:13,516 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:13,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:13,518 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:23,558 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:23,560 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:23,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:23,562 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:33,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:33,589 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:33,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:33,591 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:43,617 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:43,619 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:43,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:43,622 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] spm vds is non responsive, stopping spm selection. >2012-12-23 13:16:53,647 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:16:53,649 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:16:53,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:16:53,651 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:03,675 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:03,678 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:03,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:03,679 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:13,709 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:13,712 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:13,713 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:13,713 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:23,738 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:23,742 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:23,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:23,745 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:32,625 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-9) Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 4027fdea-c811-4bf2-b779-25dbdcacbea5 value: POOL >] >2012-12-23 13:17:32,627 WARN [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-9) CanDoAction of action MaintananceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_RESPONDING_WITH_VMS,$HostNotResponding orchid-vds1 >2012-12-23 13:17:32,627 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-9) Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 4027fdea-c811-4bf2-b779-25dbdcacbea5 value: POOL >] >2012-12-23 13:17:33,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:33,770 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:33,772 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:33,772 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:43,796 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:43,798 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:43,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:43,800 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) spm vds is non responsive, stopping spm selection. >2012-12-23 13:17:53,824 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:17:53,827 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:17:53,829 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:17:53,829 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:03,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:03,857 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:03,859 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:03,859 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:13,884 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:13,887 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:13,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:13,888 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:23,914 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:23,916 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:23,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:23,918 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:33,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:33,950 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:33,952 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:33,952 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:43,978 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:43,980 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:43,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:43,982 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:50,880 WARN [org.ovirt.engine.core.bll.SetupNetworksCommand] (ajp-/127.0.0.1:8702-7) [3b852e5b] CanDoAction of action SetupNetworks failed. Reasons:VAR__ACTION__SETUP,VAR__TYPE__NETWORKS,VAR__HOST_STATUS__UP_MAINTENANCE_OR_NON_OPERATIONAL,ACTION_TYPE_FAILED_VDS_STATUS_ILLEGAL >2012-12-23 13:18:51,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 13:18:53,321 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:18:54,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:18:54,008 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:18:54,010 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:18:54,010 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] spm vds is non responsive, stopping spm selection. >2012-12-23 13:18:55,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [15499fea] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:18:57,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:18:59,580 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:01,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:03,804 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:04,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:04,037 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:04,039 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:04,039 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:05,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:07,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [3cea5d88] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:09,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:12,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:14,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:14,065 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:14,066 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:14,066 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:14,124 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:16,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:19:18,658 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:20,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:22,774 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:24,092 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:24,094 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:24,096 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:24,096 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:24,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:26,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:28,956 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:31,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:33,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:34,121 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:34,123 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:34,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:34,125 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:35,736 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:37,515 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [2e62449f] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:19:37,516 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [2e62449f] MacPoolManager::allocateNewMac entered >2012-12-23 13:19:37,517 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [2e62449f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:58 >2012-12-23 13:19:37,614 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [959121c] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:19:37,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [959121c] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=3d5b9007-3e80-470a-8e4d-b7cee5360bf6, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:58, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=3d5b9007-3e80-470a-8e4d-b7cee5360bf6, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 581d4ef2 >2012-12-23 13:19:37,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (ajp-/127.0.0.1:8702-9) [959121c] XML RPC error in command HotPlugNicVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:37,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [959121c] FINISH, HotPlugNicVDSCommand, log id: 581d4ef2 >2012-12-23 13:19:37,623 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [959121c] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: >2012-12-23 13:19:37,672 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [959121c] Command [id=45132785-6ed6-4b9e-be2d-0bc1ef72e8a1]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmDevice; snapshot: deviceId = 3d5b9007-3e80-470a-8e4d-b7cee5360bf6, vmId = 80ab027c-2d2a-498a-94ec-bfb290566e65. >2012-12-23 13:19:37,673 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [959121c] Command [id=45132785-6ed6-4b9e-be2d-0bc1ef72e8a1]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkStatistics; snapshot: 3d5b9007-3e80-470a-8e4d-b7cee5360bf6. >2012-12-23 13:19:37,675 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [959121c] Command [id=45132785-6ed6-4b9e-be2d-0bc1ef72e8a1]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkInterface; snapshot: 3d5b9007-3e80-470a-8e4d-b7cee5360bf6. >2012-12-23 13:19:37,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:39,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:41,942 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [2d2ac2e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:43,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:44,150 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:44,152 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:44,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:44,160 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:46,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:48,083 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [15499fea] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:50,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:52,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:54,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:19:54,187 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:19:54,189 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:19:54,189 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) spm vds is non responsive, stopping spm selection. >2012-12-23 13:19:54,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:56,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:19:58,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts >2012-12-23 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering 0 hosts >2012-12-23 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Checking autorecoverable hosts done >2012-12-23 13:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-12) Autorecovering storage domains is disabled, skipping >2012-12-23 13:20:00,645 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [3cea5d88] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:20:02,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:20:04,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:20:04,219 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:20:04,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:20:04,220 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) spm vds is non responsive, stopping spm selection. >2012-12-23 13:20:04,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:20:14,246 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:20:14,248 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:20:14,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:20:14,250 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) spm vds is non responsive, stopping spm selection. >2012-12-23 13:20:24,274 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:20:24,276 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:20:24,277 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:20:24,277 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) spm vds is non responsive, stopping spm selection. >2012-12-23 13:20:34,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:20:34,304 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:20:34,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:20:34,305 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) spm vds is non responsive, stopping spm selection. >2012-12-23 13:20:52,343 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:20:52,346 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:20:52,348 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:20:52,348 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:02,373 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:02,376 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:02,377 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:02,377 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:12,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:12,405 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:12,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:12,407 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:22,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:22,441 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:22,445 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:22,445 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:32,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:32,481 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:32,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:32,482 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:42,507 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:42,509 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:42,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:42,511 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) spm vds is non responsive, stopping spm selection. >2012-12-23 13:21:52,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:21:52,537 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:21:52,539 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:21:52,539 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:02,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:02,565 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:02,566 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:02,566 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:12,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:12,593 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:12,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:12,596 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:22,630 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:22,632 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:22,634 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:22,634 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:32,658 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:32,660 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:32,662 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:32,662 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:42,686 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:42,688 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:42,690 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:42,690 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] spm vds is non responsive, stopping spm selection. >2012-12-23 13:22:52,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:22:52,719 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:22:52,720 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:22:52,720 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:02,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:02,748 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:02,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:02,749 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:07,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 13:23:12,780 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:12,782 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:12,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:12,783 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:22,808 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:22,810 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:22,811 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:22,811 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:32,859 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:32,861 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:32,863 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:32,863 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:42,888 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:42,890 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:42,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:42,892 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) spm vds is non responsive, stopping spm selection. >2012-12-23 13:23:48,427 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-48) [90f8dd8] Running command: MigrateVmCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 13:23:48,457 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-48) [90f8dd8] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 718f6345 >2012-12-23 13:23:52,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:23:52,920 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:23:52,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:23:52,922 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:02,946 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:02,948 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:02,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:02,950 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:12,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:12,977 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:12,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:12,979 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:23,003 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:23,005 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:23,007 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:23,007 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:33,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:33,034 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:33,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:33,035 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:43,059 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:43,061 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:43,063 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:43,063 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:51,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:24:51,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-48) [90f8dd8] VdsBroker::migrate::Entered (vm_guid=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 13:24:51,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-48) [90f8dd8] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 29a367d >2012-12-23 13:24:51,531 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (pool-3-thread-48) [90f8dd8] XML RPC error in command MigrateBrokerVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:24:51,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-48) [90f8dd8] FINISH, MigrateBrokerVDSCommand, log id: 29a367d >2012-12-23 13:24:51,533 ERROR [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-48) [90f8dd8] VDS::migrate:: Failed Vm migration >2012-12-23 13:24:51,555 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-48) [90f8dd8] FINISH, MigrateVDSCommand, return: Up, log id: 718f6345 >2012-12-23 13:24:51,555 ERROR [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-48) [90f8dd8] Command org.ovirt.engine.core.bll.MigrateVmCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: >2012-12-23 13:24:51,557 ERROR [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-48) [90f8dd8] Transaction rolled-back for command: org.ovirt.engine.core.bll.MigrateVmCommand. >2012-12-23 13:24:53,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:24:53,090 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:24:53,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:24:53,091 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) spm vds is non responsive, stopping spm selection. >2012-12-23 13:24:53,536 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:24:55,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts >2012-12-23 13:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering 0 hosts >2012-12-23 13:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Checking autorecoverable hosts done >2012-12-23 13:25:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-18) Autorecovering storage domains is disabled, skipping >2012-12-23 13:25:00,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:02,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:03,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:03,117 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:03,119 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:03,119 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:04,824 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:06,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:08,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:11,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:13,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:13,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:13,145 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:13,147 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:13,147 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:15,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:17,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:19,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:22,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:23,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:23,184 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:23,186 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:23,188 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:24,215 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:26,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:28,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:30,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:32,583 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:33,212 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:33,214 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:33,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:33,216 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:34,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:37,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:39,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:41,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:43,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [3717512e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:43,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:43,263 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:43,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:43,265 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:45,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:47,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:49,713 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:51,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:53,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:25:53,291 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:25:53,293 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:25:53,293 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) spm vds is non responsive, stopping spm selection. >2012-12-23 13:25:54,069 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:56,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:25:59,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [512ffd55] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:01,585 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:03,317 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:03,319 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:03,320 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:03,320 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:03,635 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:05,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:07,714 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:09,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:11,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:13,346 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:13,348 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:13,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:13,350 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:13,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:15,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:18,020 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:20,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:22,091 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:23,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:23,377 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:23,379 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:23,379 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:24,578 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:26,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [3cea5d88] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:28,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:30,949 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:33,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:33,404 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:33,406 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:33,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:33,407 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:35,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:40,131 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:41,178 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-4) Lock Acquired to object EngineLock [exclusiveLocks= , sharedLocks= key: 4027fdea-c811-4bf2-b779-25dbdcacbea5 value: POOL >] >2012-12-23 13:26:41,180 WARN [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-4) CanDoAction of action MaintananceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_RESPONDING_WITH_VMS,$HostNotResponding orchid-vds1 >2012-12-23 13:26:41,180 INFO [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-4) Lock freed to object EngineLock [exclusiveLocks= , sharedLocks= key: 4027fdea-c811-4bf2-b779-25dbdcacbea5 value: POOL >] >2012-12-23 13:26:42,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:43,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:43,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:43,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:43,447 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:44,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:46,890 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:48,928 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [947a8e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:50,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:53,045 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:53,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:26:53,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:26:53,478 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:26:53,478 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [ad2fff] spm vds is non responsive, stopping spm selection. >2012-12-23 13:26:55,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:57,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:26:59,259 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:01,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:03,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:27:03,503 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:27:03,505 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:27:03,505 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [15a44b8e] spm vds is non responsive, stopping spm selection. >2012-12-23 13:27:03,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:05,983 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:08,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:10,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:12,230 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:13,529 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:27:13,531 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:27:13,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:27:13,533 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) spm vds is non responsive, stopping spm selection. >2012-12-23 13:27:14,260 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:16,740 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:19,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:21,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:23,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:23,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:27:23,564 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:27:23,569 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:27:23,569 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) spm vds is non responsive, stopping spm selection. >2012-12-23 13:27:25,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:27,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:29,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:31,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:33,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:33,594 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:27:33,596 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:27:33,598 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:27:33,598 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) spm vds is non responsive, stopping spm selection. >2012-12-23 13:27:35,441 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:37,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:39,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:41,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:43,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:27:43,625 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:27:43,626 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:27:43,626 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:27:43,826 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:45,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:47,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:50,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:52,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:27:55,096 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:01,673 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:01,675 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:01,677 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:01,677 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:06,650 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:08,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [35251df1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:10,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:11,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [2aa79518] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:11,703 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [2aa79518] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:11,746 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [2aa79518] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:11,746 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [2aa79518] spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:12,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:14,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:17,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:19,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:21,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:21,773 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:21,775 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:21,775 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2a7e5e42] spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:21,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:23,911 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:25,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:28,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:30,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:31,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:31,802 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:31,804 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:31,804 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:32,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:34,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:37,069 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:39,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:41,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:41,827 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:41,829 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:41,831 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:41,831 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:43,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:45,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:47,885 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:49,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:51,857 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:28:51,859 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:28:51,861 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:28:51,861 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] spm vds is non responsive, stopping spm selection. >2012-12-23 13:28:52,081 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:54,127 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:56,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:28:57,917 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [1636a48d] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 13:28:57,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [1636a48d] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm4, nic=VmNetworkInterface {id=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:52, active=true, portMirroring=false, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vmName=vm4, vmTemplateId=null}, vmDevice=VmDevice {vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, deviceId=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 60e9a35b >2012-12-23 13:28:57,926 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-49) [1636a48d] Command HotUnplugNicVDS execution failed. Exception: XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:28:57,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [1636a48d] FINISH, HotUnplugNicVDSCommand, log id: 60e9a35b >2012-12-23 13:28:57,926 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [1636a48d] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 13:28:58,270 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:00,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:01,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:01,983 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:01,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:01,999 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:02,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:04,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:07,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:09,104 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:11,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:12,032 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:12,035 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:12,037 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:12,037 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:13,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:15,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:17,352 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:19,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:21,863 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:22,062 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:22,064 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:22,066 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:22,066 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [6d05d220] spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:23,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:25,998 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:28,044 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:30,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [947a8e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:32,091 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:32,093 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:32,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:32,094 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:32,215 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:34,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:36,866 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:38,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:40,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:42,119 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:42,121 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:42,123 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:42,123 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:43,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:45,078 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:47,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:49,259 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:51,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:52,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:29:52,427 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:29:52,429 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:29:52,429 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) spm vds is non responsive, stopping spm selection. >2012-12-23 13:29:54,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [f0b7261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:56,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:29:58,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-12-23 13:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-12-23 13:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-12-23 13:30:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains is disabled, skipping >2012-12-23 13:30:00,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:02,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:02,469 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:02,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:02,471 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:02,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:05,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [689999af] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:07,038 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:09,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [4be06a77] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:11,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:12,503 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:12,507 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:12,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:12,509 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:13,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:15,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:17,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:19,752 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:30:21,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [947a8e6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:22,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:22,535 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:22,536 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:22,537 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:23,951 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:25,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:28,027 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:30,062 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:32,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:32,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:32,565 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:32,567 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:32,567 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:34,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:36,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) [13e97b24] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:38,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [3c7b1ec5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:40,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:42,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:42,591 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:42,593 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:42,594 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:42,594 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:44,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:47,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:49,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:51,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:52,618 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:30:52,620 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:30:52,622 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:30:52,622 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) spm vds is non responsive, stopping spm selection. >2012-12-23 13:30:53,239 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:55,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:57,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:30:59,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:01,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:02,648 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:02,650 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:02,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:02,651 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [1e862a5d] spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:04,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:06,791 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:08,879 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [72ce052a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:10,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:12,676 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:12,678 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:12,680 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:12,680 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:13,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:15,050 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:17,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:19,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:21,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:22,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:22,721 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:22,723 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:22,723 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:23,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:25,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:27,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:29,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:31,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:32,772 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:32,774 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:32,777 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:32,777 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [5daef380] spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:33,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [54de5d37] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:35,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:38,069 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:40,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:42,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [58b180ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:42,801 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:42,803 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:42,805 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:42,805 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:44,272 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:46,715 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:48,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:50,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:52,828 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:31:52,832 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:31:52,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:31:52,836 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [3508e8f9] spm vds is non responsive, stopping spm selection. >2012-12-23 13:31:52,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:54,919 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [57696855] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:57,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:31:59,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:01,836 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:02,861 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:32:02,864 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:32:02,865 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:32:02,865 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [2ad05129] spm vds is non responsive, stopping spm selection. >2012-12-23 13:32:03,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [3707f39] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:05,965 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:08,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:10,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [5f7c22ad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:12,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:12,898 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:32:12,900 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:32:12,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:32:12,902 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) spm vds is non responsive, stopping spm selection. >2012-12-23 13:32:14,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:32:31,972 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) Start time: 12/23/12 1:32 PM >2012-12-23 13:32:32,143 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: CbcCheckOnVdsChange >2012-12-23 13:32:32,160 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: ENGINEEARLib >2012-12-23 13:32:32,165 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: CAEngineKey >2012-12-23 13:32:32,191 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: MinimalETLVersion >2012-12-23 13:32:32,320 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: ScriptsPath >2012-12-23 13:32:32,322 WARN [org.ovirt.engine.core.utils.ConfigUtilsBase] (ServerService Thread Pool -- 34) Could not find enum value for option: SQLServerI18NPrefix >2012-12-23 13:32:32,713 ERROR [org.ovirt.engine.core.engineencryptutils.EncryptionUtils] (ServerService Thread Pool -- 34) Failed to decrypt Data must start with zero >2012-12-23 13:32:32,716 ERROR [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ServerService Thread Pool -- 34) Failed to decrypt value for property TruststorePass will be used encrypted value >2012-12-23 13:32:32,807 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) VDSBrokerFrontend: 12/23/12 1:32 PM >2012-12-23 13:32:32,821 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) CpuFlagsManager: 12/23/12 1:32 PM >2012-12-23 13:32:32,821 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (ServerService Thread Pool -- 34) Setting audit clean up manager to run at: 35 35 3 * * ? >2012-12-23 13:32:32,860 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) AuditLogCleanupManager: 12/23/12 1:32 PM >2012-12-23 13:32:32,868 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 34) TagsDirector initialization >2012-12-23 13:32:32,911 INFO [org.ovirt.engine.core.bll.TagsDirector] (ServerService Thread Pool -- 34) Tag root added to tree >2012-12-23 13:32:32,939 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) TagsDirector: 12/23/12 1:32 PM >2012-12-23 13:32:32,954 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) IsoDomainListSyncronizer: 12/23/12 1:32 PM >2012-12-23 13:32:32,998 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) InitHandlers: 12/23/12 1:32 PM >2012-12-23 13:32:33,026 WARN [org.ovirt.engine.core.utils.ErrorTranslatorImpl] (ServerService Thread Pool -- 34) Code VDS_FENCING_OPERATION_FAILED appears more then once in string table. >2012-12-23 13:32:33,028 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) ErrorTranslator: 12/23/12 1:32 PM >2012-12-23 13:32:33,028 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) VdsErrorTranslator: 12/23/12 1:32 PM >2012-12-23 13:32:33,034 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) Mark uncompleted jobs as UNKNOWN: 12/23/12 1:32 PM >2012-12-23 13:32:33,113 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) JobRepositoryCleanupManager: 12/23/12 1:32 PM >2012-12-23 13:32:33,121 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) AutoRecoveryManager: 12/23/12 1:32 PM >2012-12-23 13:32:33,130 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 34) ExecutionMessageDirector: 12/23/12 1:32 PM >2012-12-23 13:32:33,299 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 35) UsersDomainsCacheManager: 12/23/12 1:32 PM >2012-12-23 13:32:33,313 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) InitResourceManager: 12/23/12 1:32 PM >2012-12-23 13:32:33,327 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) ResourceManager::ResourceManager::Entered >2012-12-23 13:32:33,459 INFO [org.ovirt.engine.core.bll.adbroker.UsersDomainsCacheManagerService] (ServerService Thread Pool -- 35) DbUserCacheManager: 12/23/12 1:32 PM >2012-12-23 13:32:33,554 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-1) DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 13:32:33,973 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: UNASSIGNED not exist in string table >2012-12-23 13:32:33,974 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not exist in string table >2012-12-23 13:32:33,974 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not exist in string table >2012-12-23 13:32:33,974 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: STORAGE_ACTIVATE_ASYNC not exist in string table >2012-12-23 13:32:33,974 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: DWH_STOPPED not exist in string table >2012-12-23 13:32:33,975 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: DWH_STARTED not exist in string table >2012-12-23 13:32:33,975 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: DWH_ERROR not exist in string table >2012-12-23 13:32:33,992 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-12-23 13:32:33,992 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_FAILED_ATTACH_DISK_TO_VM not have severity. Assumed Normal >2012-12-23 13:32:33,992 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-12-23 13:32:33,992 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_FAILED_DETACH_DISK_FROM_VM not have severity. Assumed Normal >2012-12-23 13:32:33,996 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: USER_RUN_UNLOCK_ENTITY_SCRIPT not have severity. Assumed Normal >2012-12-23 13:32:34,001 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: GLUSTER_HOST_ADD_FAILED not have severity. Assumed Normal >2012-12-23 13:32:34,001 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: VM_MIGRATION_START_SYSTEM_INITIATED not have severity. Assumed Normal >2012-12-23 13:32:34,001 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ServerService Thread Pool -- 37) AuditLogType: VDS_NETWORK_MTU_DIFFER_FROM_LOGICAL_NETWORK not have severity. Assumed Normal >2012-12-23 13:32:39,150 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-4) Checking if user admin@internal is an admin, result true >2012-12-23 13:32:39,160 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-4) Running command: LoginAdminUserCommand internal: false. >2012-12-23 13:32:39,546 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Eneterd VdsManager:constructor >2012-12-23 13:32:39,547 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) vdsBroker(orchid-vds2.qa.lab.tlv.redhat.com,54,321) >2012-12-23 13:32:39,708 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) ResourceManager::AddVds - VDS 2d10c76a-49a9-11e2-9ecf-001122334455 was added to the Resource Manager >2012-12-23 13:32:40,875 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Adding new value to configuration cache. >2012-12-23 13:32:40,880 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Didnt find the value of DBPagingType in DB for version general - using default: Offset >2012-12-23 13:32:40,881 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Adding new value to configuration cache. >2012-12-23 13:32:40,881 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Didnt find the value of DBPagingSyntax in DB for version general - using default: OFFSET (%1$s -1) LIMIT %2$s >2012-12-23 13:32:40,884 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Adding new value to configuration cache. >2012-12-23 13:32:40,884 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-3) Didnt find the value of DBSearchTemplate in DB for version general - using default: SELECT * FROM (%2$s) %1$s) as T1 %3$s >2012-12-23 13:32:44,718 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) Eneterd VdsManager:constructor >2012-12-23 13:32:44,718 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (ServerService Thread Pool -- 37) vdsBroker(orchid-vds1.qa.lab.tlv.redhat.com,54,321) >2012-12-23 13:32:44,740 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (ServerService Thread Pool -- 37) ResourceManager::AddVds - VDS 1ea924d8-49a9-11e2-bbf4-001122334455 was added to the Resource Manager >2012-12-23 13:32:44,944 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ServerService Thread Pool -- 37) AsyncTaskManager: Initialization of AsyncTaskManager completed successfully. >2012-12-23 13:32:44,944 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) AsyncTaskManager: 12/23/12 1:32 PM >2012-12-23 13:32:44,950 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) VdsLoadBalancer: 12/23/12 1:32 PM >2012-12-23 13:32:44,960 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-5) MacPoolManager started: 12/23/12 1:32 PM >2012-12-23 13:32:44,978 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (ServerService Thread Pool -- 37) Init VM Custom Properties utilities: 12/23/12 1:32 PM >2012-12-23 13:32:45,512 INFO [org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean] (pool-3-thread-5) MacPoolManager finished: 12/23/12 1:32 PM >2012-12-23 13:32:45,582 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-2) Initializing Host: orchid-vds2 >2012-12-23 13:32:45,655 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-2) [3a481226] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 13:32:46,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:32:46,833 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:32:48,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:32:48,870 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-5) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 13:32:55,055 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:32:55,064 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:32:55,082 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:32:55,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-12) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 9420e59 >2012-12-23 13:32:55,101 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-12) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:32:55,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-12) FINISH, SpmStopVDSCommand, log id: 9420e59 >2012-12-23 13:32:55,102 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:05,153 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:05,158 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:05,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:05,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-22) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 5d364dba >2012-12-23 13:33:05,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-22) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:05,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-22) FINISH, SpmStopVDSCommand, log id: 5d364dba >2012-12-23 13:33:05,174 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:15,223 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:15,226 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:15,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:15,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-32) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 793bd290 >2012-12-23 13:33:15,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-32) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:15,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-32) FINISH, SpmStopVDSCommand, log id: 793bd290 >2012-12-23 13:33:15,239 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:25,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:25,341 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:25,348 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:25,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-40) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 1ebdab2e >2012-12-23 13:33:25,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-40) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:25,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-40) FINISH, SpmStopVDSCommand, log id: 1ebdab2e >2012-12-23 13:33:25,351 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:35,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:35,394 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:35,397 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:35,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-49) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 1f868daa >2012-12-23 13:33:35,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-49) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:35,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-49) FINISH, SpmStopVDSCommand, log id: 1f868daa >2012-12-23 13:33:35,404 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:45,449 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:45,455 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:45,460 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:45,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-60) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 364e96e7 >2012-12-23 13:33:45,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-60) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:45,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-60) FINISH, SpmStopVDSCommand, log id: 364e96e7 >2012-12-23 13:33:45,464 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) spm stop on spm failed, stopping spm selection! >2012-12-23 13:33:55,502 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:33:55,506 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:33:55,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:33:55,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-69) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 7d46cc1e >2012-12-23 13:33:55,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-69) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:33:55,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-69) FINISH, SpmStopVDSCommand, log id: 7d46cc1e >2012-12-23 13:33:55,515 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:05,559 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:05,564 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:05,569 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:05,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-78) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 10d73c24 >2012-12-23 13:34:05,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-78) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:05,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-78) FINISH, SpmStopVDSCommand, log id: 10d73c24 >2012-12-23 13:34:05,571 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:15,633 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:15,638 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:15,645 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:15,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-87) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 72fe4064 >2012-12-23 13:34:15,648 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-87) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:15,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-87) FINISH, SpmStopVDSCommand, log id: 72fe4064 >2012-12-23 13:34:15,649 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:25,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:26,042 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:26,058 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:26,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-96) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 17068275 >2012-12-23 13:34:26,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-96) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:26,060 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-96) FINISH, SpmStopVDSCommand, log id: 17068275 >2012-12-23 13:34:26,060 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:36,112 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:36,117 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:36,122 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:36,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-5) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 74e654ce >2012-12-23 13:34:36,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-5) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:36,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-5) FINISH, SpmStopVDSCommand, log id: 74e654ce >2012-12-23 13:34:36,124 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:46,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:46,164 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:46,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:46,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-17) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 6943f9a3 >2012-12-23 13:34:46,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-17) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:46,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-17) FINISH, SpmStopVDSCommand, log id: 6943f9a3 >2012-12-23 13:34:46,172 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) spm stop on spm failed, stopping spm selection! >2012-12-23 13:34:56,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:34:56,209 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:34:56,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:34:56,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-26) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 2ebde801 >2012-12-23 13:34:56,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-26) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:34:56,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-26) FINISH, SpmStopVDSCommand, log id: 2ebde801 >2012-12-23 13:34:56,213 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts >2012-12-23 13:35:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering 0 hosts >2012-12-23 13:35:00,024 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Checking autorecoverable hosts done >2012-12-23 13:35:00,025 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-27) Autorecovering storage domains is disabled, skipping >2012-12-23 13:35:06,251 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:06,256 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:06,263 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:06,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-36) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 3dd2b089 >2012-12-23 13:35:06,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-36) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:35:06,266 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-36) FINISH, SpmStopVDSCommand, log id: 3dd2b089 >2012-12-23 13:35:06,266 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:16,303 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:16,305 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:16,311 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:16,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-45) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 65657542 >2012-12-23 13:35:16,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-45) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:35:16,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-45) FINISH, SpmStopVDSCommand, log id: 65657542 >2012-12-23 13:35:16,318 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:26,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:26,353 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:26,355 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:26,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-54) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 8f874e2 >2012-12-23 13:35:26,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-54) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:35:26,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-54) FINISH, SpmStopVDSCommand, log id: 8f874e2 >2012-12-23 13:35:26,359 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:36,407 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:36,411 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:36,414 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:36,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-63) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 378eaf9d >2012-12-23 13:35:36,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-63) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:35:36,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-63) FINISH, SpmStopVDSCommand, log id: 378eaf9d >2012-12-23 13:35:36,420 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:46,470 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:46,501 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:46,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:46,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 5e2d23b9 >2012-12-23 13:35:46,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) SpmStopVDSCommand:: vds orchid-vds1 is in Connecting status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:35:46,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (QuartzScheduler_Worker-74) FINISH, SpmStopVDSCommand, log id: 5e2d23b9 >2012-12-23 13:35:46,509 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) spm stop on spm failed, stopping spm selection! >2012-12-23 13:35:50,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 13:35:50,991 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-7) VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 13:35:51,088 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-49) ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 13:35:51,224 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-49) [35fcf704] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 13:35:53,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:35:55,228 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:35:56,545 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:35:56,550 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:35:56,552 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:35:56,552 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) spm vds is non responsive, stopping spm selection. >2012-12-23 13:35:57,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:35:59,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:01,901 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:03,971 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:06,026 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:06,597 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:06,600 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:06,607 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:06,607 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:08,083 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:10,131 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:12,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:14,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:16,639 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:16,662 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:16,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:16,667 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:16,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:19,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:21,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:23,938 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:26,023 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:26,696 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:26,702 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:26,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:26,707 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:28,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:30,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:32,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:34,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:36,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:36,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:36,773 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:36,778 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:36,778 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:38,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:40,851 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:43,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:45,109 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:46,823 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:46,829 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:46,831 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:46,831 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:47,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:49,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:36:52,084 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:54,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:56,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:36:56,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:36:56,884 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:36:56,893 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:36:56,894 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) spm vds is non responsive, stopping spm selection. >2012-12-23 13:36:58,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:37:00,401 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:02,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:04,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:06,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:06,927 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:06,930 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:06,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:06,932 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:08,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:10,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:13,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:37:15,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:16,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:16,981 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:16,983 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:16,983 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:17,341 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:19,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:21,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:23,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:25,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:27,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:27,023 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:27,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:27,025 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:27,946 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:30,024 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:32,141 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:34,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:36,838 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:37,052 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:37,055 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:37,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:37,057 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:38,876 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:40,937 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:42,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:45,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:47,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:37:47,130 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:47,154 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:47,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:47,156 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:49,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:51,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:53,305 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:55,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:57,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:37:57,230 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:37:57,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:37:57,232 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) spm vds is non responsive, stopping spm selection. >2012-12-23 13:37:57,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:37:59,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:01,717 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:03,774 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:05,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:07,260 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:07,264 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:07,267 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:07,267 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:07,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:09,933 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:12,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:14,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:16,259 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:17,300 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:17,303 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:17,305 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:17,305 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:18,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:20,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:22,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:24,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:26,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:27,332 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:27,337 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:27,340 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:27,340 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:28,845 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:30,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:32,970 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:35,060 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:37,112 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:37,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:37,369 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:37,371 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:37,371 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:39,365 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:41,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:43,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:45,919 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:47,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:47,409 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:47,414 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:47,414 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:47,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:50,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:52,062 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:54,124 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:38:56,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:38:57,461 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:38:57,466 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:38:57,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:38:57,468 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) spm vds is non responsive, stopping spm selection. >2012-12-23 13:38:58,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:00,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:02,667 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:04,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:06,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:07,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:07,508 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:07,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:07,510 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) spm vds is non responsive, stopping spm selection. >2012-12-23 13:39:08,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:10,950 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:12,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:15,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:17,081 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:17,555 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:17,571 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:17,573 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:17,573 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) spm vds is non responsive, stopping spm selection. >2012-12-23 13:39:19,126 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:21,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:23,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:25,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:27,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:27,608 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:27,611 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:27,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:27,613 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) spm vds is non responsive, stopping spm selection. >2012-12-23 13:39:29,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:31,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:33,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:35,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:37,657 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:37,660 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:37,663 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:37,663 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm vds is non responsive, stopping spm selection. >2012-12-23 13:39:38,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:40,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:42,290 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:44,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:46,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:39:47,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:47,718 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:47,720 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:47,720 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) spm vds is non responsive, stopping spm selection. >2012-12-23 13:39:57,751 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:39:57,756 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:39:57,760 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:39:57,760 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts >2012-12-23 13:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering 0 hosts >2012-12-23 13:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Checking autorecoverable hosts done >2012-12-23 13:40:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-25) Autorecovering storage domains is disabled, skipping >2012-12-23 13:40:07,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:07,791 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:07,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:07,793 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:17,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:17,839 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:17,841 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:17,841 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:27,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:27,872 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:27,874 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:27,874 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:37,905 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:37,907 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:37,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:37,909 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:47,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:47,952 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:47,957 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:47,957 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) spm vds is non responsive, stopping spm selection. >2012-12-23 13:40:57,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:40:57,988 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:40:57,990 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:40:57,990 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:08,019 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:08,022 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:08,024 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:08,024 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:18,069 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:18,072 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:18,073 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:18,074 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:28,109 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:28,111 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:28,113 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:28,113 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:38,146 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:38,149 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:38,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:38,151 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:48,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:48,181 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:48,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:48,183 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) spm vds is non responsive, stopping spm selection. >2012-12-23 13:41:58,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:41:58,218 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:41:58,220 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:41:58,220 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:08,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:08,259 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:08,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:08,261 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:18,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:18,291 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:18,293 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:18,293 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:28,330 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:28,333 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:28,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:28,335 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:38,392 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:38,395 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:38,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:38,400 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:48,428 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:48,430 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:48,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:48,436 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:48,893 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 13:42:51,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:42:53,068 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:42:55,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:42:57,248 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:42:58,482 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:42:58,488 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:42:58,490 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:42:58,490 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) spm vds is non responsive, stopping spm selection. >2012-12-23 13:42:59,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:01,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:03,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:05,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:07,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:08,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:08,520 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:08,522 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:08,522 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) spm vds is non responsive, stopping spm selection. >2012-12-23 13:43:09,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:11,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:13,855 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:15,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:18,024 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:18,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:18,552 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:18,554 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:18,554 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) spm vds is non responsive, stopping spm selection. >2012-12-23 13:43:20,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:22,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:24,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:26,239 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:28,586 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:28,588 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:28,593 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:28,596 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:28,596 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) spm vds is non responsive, stopping spm selection. >2012-12-23 13:43:30,621 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:32,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:34,716 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:36,937 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:38,621 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:38,624 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:38,626 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:38,626 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:43:38,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:41,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:43,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:45,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:47,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:48,705 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:48,710 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:48,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:48,712 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) spm vds is non responsive, stopping spm selection. >2012-12-23 13:43:49,328 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:52,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:54,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:43:56,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:58,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:43:58,810 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:43:58,813 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:43:58,815 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:43:58,815 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:00,300 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:02,635 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:04,670 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:06,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:08,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:08,850 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:08,852 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:08,852 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:09,038 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:11,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:13,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:15,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:17,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:18,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:18,882 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:18,884 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:18,884 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:20,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:22,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:24,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:26,714 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:28,784 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:28,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:28,911 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:28,913 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:28,913 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:30,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:32,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:35,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:37,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:38,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:38,946 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:38,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:38,948 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:39,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:41,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:43,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:45,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:47,379 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:44:48,989 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:48,992 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:48,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:48,994 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:49,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:51,752 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:53,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:55,844 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:57,885 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:59,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:44:59,025 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:44:59,027 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:44:59,027 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) spm vds is non responsive, stopping spm selection. >2012-12-23 13:44:59,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:44:59,999 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts >2012-12-23 13:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering 0 hosts >2012-12-23 13:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Checking autorecoverable hosts done >2012-12-23 13:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-71) Autorecovering storage domains is disabled, skipping >2012-12-23 13:45:02,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:04,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:06,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:08,880 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:09,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:09,070 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:09,072 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:09,072 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) spm vds is non responsive, stopping spm selection. >2012-12-23 13:45:10,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:13,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:15,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:17,216 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:45:19,103 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:19,105 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:19,107 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:19,107 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm vds is non responsive, stopping spm selection. >2012-12-23 13:45:19,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:45:21,788 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:23,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:25,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:45:29,135 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:29,138 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:29,140 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:29,140 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) spm vds is non responsive, stopping spm selection. >2012-12-23 13:45:39,167 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:39,170 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:39,172 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:39,172 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) spm vds is non responsive, stopping spm selection. >2012-12-23 13:45:49,199 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:49,203 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:49,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:49,205 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) spm vds is non responsive, stopping spm selection. >2012-12-23 13:45:59,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:45:59,242 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:45:59,244 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:45:59,244 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:09,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:09,287 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:09,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:09,289 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:19,320 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:19,322 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:19,323 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:19,324 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:29,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:29,352 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:29,353 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:29,353 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:39,382 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:39,385 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:39,387 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:39,387 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:49,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:49,436 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:49,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:49,438 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) spm vds is non responsive, stopping spm selection. >2012-12-23 13:46:59,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:46:59,471 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:46:59,472 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:46:59,472 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:09,505 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:09,508 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:09,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:09,510 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:19,552 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:19,555 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:19,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:19,557 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:29,585 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:29,587 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:29,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:29,588 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:39,619 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:39,621 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:39,623 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:39,623 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:49,649 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:49,652 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:49,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:49,654 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) spm vds is non responsive, stopping spm selection. >2012-12-23 13:47:59,684 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:47:59,688 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:47:59,692 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:47:59,692 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:09,724 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:09,727 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:09,729 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:09,729 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:19,756 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:19,759 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:19,760 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:19,760 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:28,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 13:48:29,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:29,788 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:29,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:29,790 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:39,819 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:39,821 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:39,823 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:39,823 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:49,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:48:49,960 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:49,963 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:49,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:49,965 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] spm vds is non responsive, stopping spm selection. >2012-12-23 13:48:51,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:48:53,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:48:56,034 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:48:58,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:48:59,990 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:48:59,993 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) SPM Init: could not find reported vds or not up - pool:DC31-CLI vds_spm_id: 1 >2012-12-23 13:48:59,994 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) SPM selection - vds seems as spm orchid-vds1 >2012-12-23 13:48:59,994 WARN [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) spm vds is non responsive, stopping spm selection. >2012-12-23 13:49:00,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:02,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:03,608 INFO [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (ajp-/127.0.0.1:8702-5) Lock Acquired to object EngineLock [exclusiveLocks= key: 1ea924d8-49a9-11e2-bbf4-001122334455 value: VDS_FENCE >, sharedLocks= ] >2012-12-23 13:49:03,618 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-5) Adding new value to configuration cache. >2012-12-23 13:49:03,625 WARN [org.ovirt.engine.core.dal.dbbroker.generic.DBConfigUtils] (ajp-/127.0.0.1:8702-5) Didnt find the value of DBI18NPrefix in DB for version general - using default: >2012-12-23 13:49:03,650 INFO [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (pool-3-thread-49) [413ba32a] Running command: FenceVdsManualyCommand internal: false. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 13:49:03,722 INFO [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (pool-3-thread-49) [413ba32a] Trying to fence spm orchid-vds1 via vds orchid-vds2 >2012-12-23 13:49:03,725 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceSpmStorageVDSCommand] (pool-3-thread-49) [413ba32a] START, FenceSpmStorageVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=1, prevLVER=2), log id: 2505b13e >2012-12-23 13:49:03,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FenceSpmStorageVDSCommand] (pool-3-thread-49) [413ba32a] FINISH, FenceSpmStorageVDSCommand, log id: 2505b13e >2012-12-23 13:49:03,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-49) [413ba32a] START, ResetIrsVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, hostName = orchid-vds1.qa.lab.tlv.redhat.com, vdsId = 1ea924d8-49a9-11e2-bbf4-001122334455, ignoreStopFailed = true), log id: 6702ad19 >2012-12-23 13:49:03,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-49) [413ba32a] START, SpmStopVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 22a29f97 >2012-12-23 13:49:03,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-49) [413ba32a] SpmStopVDSCommand:: vds orchid-vds1 is in NonResponsive status - not performing spm stop, pool id 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 13:49:03,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStopVDSCommand] (pool-3-thread-49) [413ba32a] FINISH, SpmStopVDSCommand, log id: 22a29f97 >2012-12-23 13:49:03,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.ResetIrsVDSCommand] (pool-3-thread-49) [413ba32a] FINISH, ResetIrsVDSCommand, log id: 6702ad19 >2012-12-23 13:49:03,825 INFO [org.ovirt.engine.core.bll.ClearNonResponsiveVdsVmsCommand] (pool-3-thread-49) [3c9b60d0] Running command: ClearNonResponsiveVdsVmsCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 13:49:03,828 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] START, SetVmStatusVDSCommand( vmId = 2e79d247-3ef0-4fc5-b865-ed1092c89a89, status = Down), log id: 7bdbc20b >2012-12-23 13:49:03,847 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] FINISH, SetVmStatusVDSCommand, log id: 7bdbc20b >2012-12-23 13:49:03,912 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] START, SetVmStatusVDSCommand( vmId = 80ab027c-2d2a-498a-94ec-bfb290566e65, status = Down), log id: 4b083ce6 >2012-12-23 13:49:03,918 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] FINISH, SetVmStatusVDSCommand, log id: 4b083ce6 >2012-12-23 13:49:03,929 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] START, SetVmStatusVDSCommand( vmId = 22ee2cb6-d617-44ce-b650-d16607825589, status = Down), log id: 72e7296f >2012-12-23 13:49:03,931 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] FINISH, SetVmStatusVDSCommand, log id: 72e7296f >2012-12-23 13:49:03,940 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] START, SetVmStatusVDSCommand( vmId = ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, status = Down), log id: 180889c7 >2012-12-23 13:49:03,942 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (pool-3-thread-49) [3c9b60d0] FINISH, SetVmStatusVDSCommand, log id: 180889c7 >2012-12-23 13:49:03,953 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsVMsClearedVDSCommand] (pool-3-thread-49) [3c9b60d0] START, UpdateVdsVMsClearedVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: 7f4b7173 >2012-12-23 13:49:03,953 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsVMsClearedVDSCommand] (pool-3-thread-49) [3c9b60d0] FINISH, UpdateVdsVMsClearedVDSCommand, log id: 7f4b7173 >2012-12-23 13:49:03,988 INFO [org.ovirt.engine.core.bll.storage.FenceVdsManualyCommand] (pool-3-thread-49) [3c9b60d0] Lock freed to object EngineLock [exclusiveLocks= key: 1ea924d8-49a9-11e2-bbf4-001122334455 value: VDS_FENCE >, sharedLocks= ] >2012-12-23 13:49:04,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:06,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:08,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:10,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:49:10,105 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:49:10,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2275f949 >2012-12-23 13:49:10,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) spmStart polling started: taskId = 3a69deb9-9feb-45d3-a4d9-d886dd9c0f21 >2012-12-23 13:49:10,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:11,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:49:11,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:11,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) spmStart polling ended: taskId = 3a69deb9-9feb-45d3-a4d9-d886dd9c0f21 task status = finished >2012-12-23 13:49:11,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:11,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) spmStart polling ended, spm status: Free >2012-12-23 13:49:11,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3a69deb9-9feb-45d3-a4d9-d886dd9c0f21), log id: 14ceaa72 >2012-12-23 13:49:11,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) FINISH, HSMClearTaskVDSCommand, log id: 14ceaa72 >2012-12-23 13:49:11,225 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@24e9ee08, log id: 2275f949 >2012-12-23 13:49:11,241 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [7a0a6226] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:49:11,444 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:49:12,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:14,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:49:16,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:19,008 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:21,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:49:21,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:49:21,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6ecbfd7a >2012-12-23 13:49:21,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) spmStart polling started: taskId = 790af7b0-3bb6-4ada-9889-65a59d54d09c >2012-12-23 13:49:21,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:22,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:49:22,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:22,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) spmStart polling ended: taskId = 790af7b0-3bb6-4ada-9889-65a59d54d09c task status = finished >2012-12-23 13:49:22,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:22,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) spmStart polling ended, spm status: Free >2012-12-23 13:49:22,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=790af7b0-3bb6-4ada-9889-65a59d54d09c), log id: 4a89bbc6 >2012-12-23 13:49:22,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) FINISH, HSMClearTaskVDSCommand, log id: 4a89bbc6 >2012-12-23 13:49:22,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@41869977, log id: 6ecbfd7a >2012-12-23 13:49:22,616 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-47) [6bc5753c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:49:22,671 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:49:23,671 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:49:25,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:27,814 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:29,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:32,065 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:32,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:49:32,751 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:49:32,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2e356127 >2012-12-23 13:49:32,776 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) spmStart polling started: taskId = d458f569-7731-4d45-b186-0c9ba43890cb >2012-12-23 13:49:33,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:49:33,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:33,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) spmStart polling ended: taskId = d458f569-7731-4d45-b186-0c9ba43890cb task status = finished >2012-12-23 13:49:33,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:33,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) spmStart polling ended, spm status: Free >2012-12-23 13:49:33,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-63) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d458f569-7731-4d45-b186-0c9ba43890cb), log id: f4918e2 >2012-12-23 13:49:33,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-63) FINISH, HSMClearTaskVDSCommand, log id: f4918e2 >2012-12-23 13:49:33,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@800a545, log id: 2e356127 >2012-12-23 13:49:33,845 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-63) [6262591d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:49:33,949 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:49:34,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:36,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:38,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:40,333 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:42,385 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:43,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:49:43,992 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:49:43,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5fcd149a >2012-12-23 13:49:44,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) spmStart polling started: taskId = 47b46679-1ddb-4a85-a65c-f96e704b5afc >2012-12-23 13:49:44,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:45,039 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:49:45,039 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:45,040 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) spmStart polling ended: taskId = 47b46679-1ddb-4a85-a65c-f96e704b5afc task status = finished >2012-12-23 13:49:45,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:45,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) spmStart polling ended, spm status: Free >2012-12-23 13:49:45,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-76) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=47b46679-1ddb-4a85-a65c-f96e704b5afc), log id: 1d309e22 >2012-12-23 13:49:45,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-76) FINISH, HSMClearTaskVDSCommand, log id: 1d309e22 >2012-12-23 13:49:45,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@62ddd926, log id: 5fcd149a >2012-12-23 13:49:45,097 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-76) [52db807f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:49:45,176 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:49:46,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:49,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:51,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:53,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:55,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:49:55,231 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:49:55,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1c42af8e >2012-12-23 13:49:55,264 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) spmStart polling started: taskId = 1eb20f18-53ae-4b84-ac42-2a1256ca31b0 >2012-12-23 13:49:55,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:49:56,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:49:56,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:56,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) spmStart polling ended: taskId = 1eb20f18-53ae-4b84-ac42-2a1256ca31b0 task status = finished >2012-12-23 13:49:56,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:49:56,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) spmStart polling ended, spm status: Free >2012-12-23 13:49:56,328 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1eb20f18-53ae-4b84-ac42-2a1256ca31b0), log id: 3d109acd >2012-12-23 13:49:56,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) FINISH, HSMClearTaskVDSCommand, log id: 3d109acd >2012-12-23 13:49:56,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@d23280d, log id: 1c42af8e >2012-12-23 13:49:56,363 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-92) [4cede70f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:49:56,436 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:49:57,322 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts >2012-12-23 13:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering 0 hosts >2012-12-23 13:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Checking autorecoverable hosts done >2012-12-23 13:50:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-100) Autorecovering storage domains is disabled, skipping >2012-12-23 13:50:00,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:02,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:04,276 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:06,477 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:50:06,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:50:06,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 286c4992 >2012-12-23 13:50:06,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) spmStart polling started: taskId = d89fc1a5-01ed-45e6-b8d2-2aedc5061bce >2012-12-23 13:50:06,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:08,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:11,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:11,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:50:11,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:11,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) spmStart polling ended: taskId = d89fc1a5-01ed-45e6-b8d2-2aedc5061bce task status = finished >2012-12-23 13:50:11,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:11,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) spmStart polling ended, spm status: Free >2012-12-23 13:50:11,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d89fc1a5-01ed-45e6-b8d2-2aedc5061bce), log id: 3ad4e9eb >2012-12-23 13:50:11,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) FINISH, HSMClearTaskVDSCommand, log id: 3ad4e9eb >2012-12-23 13:50:11,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@70496179, log id: 286c4992 >2012-12-23 13:50:11,725 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [619e8886] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:50:11,796 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [619e8886] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:50:13,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:15,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:17,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:19,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:21,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:21,882 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:50:21,897 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:50:21,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1b110829 >2012-12-23 13:50:21,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) spmStart polling started: taskId = 36e5dda8-a74e-4663-9f7e-93556da43bd4 >2012-12-23 13:50:22,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:50:22,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:22,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) spmStart polling ended: taskId = 36e5dda8-a74e-4663-9f7e-93556da43bd4 task status = finished >2012-12-23 13:50:22,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:22,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) spmStart polling ended, spm status: Free >2012-12-23 13:50:22,993 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=36e5dda8-a74e-4663-9f7e-93556da43bd4), log id: 55b04376 >2012-12-23 13:50:23,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) FINISH, HSMClearTaskVDSCommand, log id: 55b04376 >2012-12-23 13:50:23,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@271d23ed, log id: 1b110829 >2012-12-23 13:50:23,023 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-33) [6a21b0aa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:50:23,099 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [6a21b0aa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:50:23,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:25,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:27,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:30,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:50:32,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:33,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:50:33,146 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:50:33,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: df9dc0b >2012-12-23 13:50:33,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) spmStart polling started: taskId = 8f73541d-aef8-406c-9644-25611897fe26 >2012-12-23 13:50:34,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:50:34,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:34,195 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) spmStart polling ended: taskId = 8f73541d-aef8-406c-9644-25611897fe26 task status = finished >2012-12-23 13:50:34,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:34,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) spmStart polling ended, spm status: Free >2012-12-23 13:50:34,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8f73541d-aef8-406c-9644-25611897fe26), log id: 16f15c6a >2012-12-23 13:50:34,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) FINISH, HSMClearTaskVDSCommand, log id: 16f15c6a >2012-12-23 13:50:34,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3fea3eea, log id: df9dc0b >2012-12-23 13:50:34,259 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-49) [2bc8956e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:50:34,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:35,075 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:50:37,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:39,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:41,277 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:50:43,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:45,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:50:45,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:50:45,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3c5d9f3c >2012-12-23 13:50:45,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) spmStart polling started: taskId = c2d3b0da-8a17-4294-afb8-1bad1d14a533 >2012-12-23 13:50:45,362 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:47,391 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:49,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:52,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:52,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:50:52,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:52,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) spmStart polling ended: taskId = c2d3b0da-8a17-4294-afb8-1bad1d14a533 task status = finished >2012-12-23 13:50:52,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:50:52,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) spmStart polling ended, spm status: Free >2012-12-23 13:50:52,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c2d3b0da-8a17-4294-afb8-1bad1d14a533), log id: 7e12938c >2012-12-23 13:50:52,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) FINISH, HSMClearTaskVDSCommand, log id: 7e12938c >2012-12-23 13:50:52,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75950cfd, log id: 3c5d9f3c >2012-12-23 13:50:52,419 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-65) [c87f25a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:50:52,447 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:50:54,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:56,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:50:58,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:02,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:51:02,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:51:02,503 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6807c31 >2012-12-23 13:51:02,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling started: taskId = fff8976a-4ba8-4569-b03b-9aeee926f400 >2012-12-23 13:51:03,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:03,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:51:03,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:03,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling ended: taskId = fff8976a-4ba8-4569-b03b-9aeee926f400 task status = finished >2012-12-23 13:51:03,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:03,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) spmStart polling ended, spm status: Free >2012-12-23 13:51:03,569 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=fff8976a-4ba8-4569-b03b-9aeee926f400), log id: 6e0e7ba1 >2012-12-23 13:51:03,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) FINISH, HSMClearTaskVDSCommand, log id: 6e0e7ba1 >2012-12-23 13:51:03,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@78d6bf79, log id: 6807c31 >2012-12-23 13:51:03,594 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-14) [5ab4dee9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:51:03,629 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [5ab4dee9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:51:05,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:07,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:09,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:12,088 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:13,655 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:51:13,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:51:13,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 72a47131 >2012-12-23 13:51:13,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) spmStart polling started: taskId = 32ff01d6-20e2-4147-9631-c500fcec5490 >2012-12-23 13:51:14,168 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:14,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:51:14,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:14,805 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) spmStart polling ended: taskId = 32ff01d6-20e2-4147-9631-c500fcec5490 task status = finished >2012-12-23 13:51:14,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:14,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) spmStart polling ended, spm status: Free >2012-12-23 13:51:14,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=32ff01d6-20e2-4147-9631-c500fcec5490), log id: 6765bd7e >2012-12-23 13:51:14,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) FINISH, HSMClearTaskVDSCommand, log id: 6765bd7e >2012-12-23 13:51:14,846 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@487bd03a, log id: 72a47131 >2012-12-23 13:51:14,852 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-99) [38a3b503] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:51:15,470 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [38a3b503] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:51:16,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:18,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:20,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:22,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:24,642 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:25,499 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:51:25,517 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:51:25,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 56423360 >2012-12-23 13:51:25,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling started: taskId = 888026f8-5e2a-4fd9-8563-f819742245f4 >2012-12-23 13:51:26,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:51:26,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:26,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling ended: taskId = 888026f8-5e2a-4fd9-8563-f819742245f4 task status = finished >2012-12-23 13:51:26,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:26,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) spmStart polling ended, spm status: Free >2012-12-23 13:51:26,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=888026f8-5e2a-4fd9-8563-f819742245f4), log id: 780cba8d >2012-12-23 13:51:26,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) FINISH, HSMClearTaskVDSCommand, log id: 780cba8d >2012-12-23 13:51:26,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@babbc8e, log id: 56423360 >2012-12-23 13:51:26,608 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-20) [37e8149e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:51:26,799 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:27,790 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [37e8149e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:51:29,794 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:32,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:34,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:36,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:37,821 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:51:37,856 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:51:37,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 163ef03d >2012-12-23 13:51:37,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) spmStart polling started: taskId = f1a81b33-51d4-4bb9-b4e6-bd49cbaabefa >2012-12-23 13:51:38,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:51:38,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:38,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) spmStart polling ended: taskId = f1a81b33-51d4-4bb9-b4e6-bd49cbaabefa task status = finished >2012-12-23 13:51:38,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:38,929 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) spmStart polling ended, spm status: Free >2012-12-23 13:51:38,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f1a81b33-51d4-4bb9-b4e6-bd49cbaabefa), log id: 5c6012a1 >2012-12-23 13:51:38,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) FINISH, HSMClearTaskVDSCommand, log id: 5c6012a1 >2012-12-23 13:51:38,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@27673768, log id: 163ef03d >2012-12-23 13:51:38,953 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-35) [6966a10d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:51:39,117 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:51:39,381 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:41,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:44,053 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:46,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:48,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:49,145 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:51:49,160 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:51:49,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: d8ac3e2 >2012-12-23 13:51:49,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) spmStart polling started: taskId = df9659a0-4575-496e-950a-02bf52620128 >2012-12-23 13:51:50,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:52,321 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:53,314 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:51:53,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:53,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) spmStart polling ended: taskId = df9659a0-4575-496e-950a-02bf52620128 task status = finished >2012-12-23 13:51:53,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:51:53,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) spmStart polling ended, spm status: Free >2012-12-23 13:51:53,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-51) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=df9659a0-4575-496e-950a-02bf52620128), log id: cdaef6d >2012-12-23 13:51:53,355 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-51) FINISH, HSMClearTaskVDSCommand, log id: cdaef6d >2012-12-23 13:51:53,356 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@799ce3b2, log id: d8ac3e2 >2012-12-23 13:51:53,358 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-51) [2b28f97e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:51:53,611 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:51:54,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:51:56,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:51:59,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:01,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:03,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:03,749 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:52:03,762 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:52:03,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 57fc85d8 >2012-12-23 13:52:03,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) spmStart polling started: taskId = edb59735-5606-4956-9ee9-1a5a792b9058 >2012-12-23 13:52:04,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:52:04,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:04,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) spmStart polling ended: taskId = edb59735-5606-4956-9ee9-1a5a792b9058 task status = finished >2012-12-23 13:52:04,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:04,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) spmStart polling ended, spm status: Free >2012-12-23 13:52:04,832 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=edb59735-5606-4956-9ee9-1a5a792b9058), log id: 6d20b29f >2012-12-23 13:52:04,851 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) FINISH, HSMClearTaskVDSCommand, log id: 6d20b29f >2012-12-23 13:52:04,851 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7daf1cb1, log id: 57fc85d8 >2012-12-23 13:52:04,854 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-73) [7234eda1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:52:04,880 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:52:05,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:07,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:09,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:11,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:13,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:14,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:52:15,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:52:15,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 222c42f8 >2012-12-23 13:52:15,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) spmStart polling started: taskId = 3f0ce8d0-c104-4bbb-8ed5-1931599c9b37 >2012-12-23 13:52:16,071 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:16,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:52:16,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:16,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) spmStart polling ended: taskId = 3f0ce8d0-c104-4bbb-8ed5-1931599c9b37 task status = finished >2012-12-23 13:52:16,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:16,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) spmStart polling ended, spm status: Free >2012-12-23 13:52:16,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3f0ce8d0-c104-4bbb-8ed5-1931599c9b37), log id: 26e73bbc >2012-12-23 13:52:16,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) FINISH, HSMClearTaskVDSCommand, log id: 26e73bbc >2012-12-23 13:52:16,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@26ed3249, log id: 222c42f8 >2012-12-23 13:52:16,571 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [4c716d46] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:52:16,903 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:52:18,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:20,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:22,225 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:24,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:26,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:26,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:52:26,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [3a481226] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:52:26,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: ad86536 >2012-12-23 13:52:26,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] spmStart polling started: taskId = 1d097c1d-3134-475f-929e-10b03a0413b6 >2012-12-23 13:52:28,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [3a481226] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:52:28,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [3a481226] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:28,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] spmStart polling ended: taskId = 1d097c1d-3134-475f-929e-10b03a0413b6 task status = finished >2012-12-23 13:52:28,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:28,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] spmStart polling ended, spm status: Free >2012-12-23 13:52:28,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [3a481226] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1d097c1d-3134-475f-929e-10b03a0413b6), log id: 74ced93a >2012-12-23 13:52:28,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [3a481226] FINISH, HSMClearTaskVDSCommand, log id: 74ced93a >2012-12-23 13:52:28,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [3a481226] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3817aabf, log id: ad86536 >2012-12-23 13:52:28,053 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-2) [19cafe5e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:52:28,091 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:52:28,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [38a3b503] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:30,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:33,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:38,118 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:52:38,179 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:52:38,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 763daca2 >2012-12-23 13:52:38,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) spmStart polling started: taskId = 88d105b5-51d7-4a8a-b5aa-e77defe1105c >2012-12-23 13:52:38,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [619e8886] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:39,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:52:39,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:39,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) spmStart polling ended: taskId = 88d105b5-51d7-4a8a-b5aa-e77defe1105c task status = finished >2012-12-23 13:52:39,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:39,248 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) spmStart polling ended, spm status: Free >2012-12-23 13:52:39,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=88d105b5-51d7-4a8a-b5aa-e77defe1105c), log id: 6b88b887 >2012-12-23 13:52:39,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) FINISH, HSMClearTaskVDSCommand, log id: 6b88b887 >2012-12-23 13:52:39,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5d0ade38, log id: 763daca2 >2012-12-23 13:52:39,286 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-18) [74835e40] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:52:39,330 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:52:40,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:42,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:44,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:52:47,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:49,092 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:49,925 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:52:50,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:52:50,497 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 32f10d1b >2012-12-23 13:52:50,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) spmStart polling started: taskId = 81b5ff48-23f1-4040-803c-246ba7cd26da >2012-12-23 13:52:51,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:53,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:52:53,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:53,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) spmStart polling ended: taskId = 81b5ff48-23f1-4040-803c-246ba7cd26da task status = finished >2012-12-23 13:52:53,590 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:52:53,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) spmStart polling ended, spm status: Free >2012-12-23 13:52:53,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=81b5ff48-23f1-4040-803c-246ba7cd26da), log id: 604a993b >2012-12-23 13:52:53,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) FINISH, HSMClearTaskVDSCommand, log id: 604a993b >2012-12-23 13:52:53,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@419221e0, log id: 32f10d1b >2012-12-23 13:52:53,632 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [60ee1ac1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:52:53,678 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [60ee1ac1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:52:53,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:56,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:52:58,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:00,219 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:02,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:03,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:53:03,720 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:53:03,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 599c3121 >2012-12-23 13:53:03,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) spmStart polling started: taskId = 567cb214-dc25-44ac-a6b2-5193b70c3f04 >2012-12-23 13:53:04,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:53:04,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:04,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) spmStart polling ended: taskId = 567cb214-dc25-44ac-a6b2-5193b70c3f04 task status = finished >2012-12-23 13:53:04,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:04,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) spmStart polling ended, spm status: Free >2012-12-23 13:53:04,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=567cb214-dc25-44ac-a6b2-5193b70c3f04), log id: 7aefb163 >2012-12-23 13:53:04,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) FINISH, HSMClearTaskVDSCommand, log id: 7aefb163 >2012-12-23 13:53:04,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@e6719a3, log id: 599c3121 >2012-12-23 13:53:04,829 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [12c423b8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:53:05,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:05,143 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [12c423b8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:53:07,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:09,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:11,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:13,568 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:15,267 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:53:15,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:53:15,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 18fde5ec >2012-12-23 13:53:15,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) spmStart polling started: taskId = a88f88f9-375f-4b57-ba35-ba8ab4a563e4 >2012-12-23 13:53:15,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:16,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:53:16,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:16,483 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) spmStart polling ended: taskId = a88f88f9-375f-4b57-ba35-ba8ab4a563e4 task status = finished >2012-12-23 13:53:16,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:16,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) spmStart polling ended, spm status: Free >2012-12-23 13:53:16,502 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a88f88f9-375f-4b57-ba35-ba8ab4a563e4), log id: 68794a69 >2012-12-23 13:53:16,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) FINISH, HSMClearTaskVDSCommand, log id: 68794a69 >2012-12-23 13:53:16,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@73046914, log id: 18fde5ec >2012-12-23 13:53:16,523 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-69) [268edb0a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:53:17,225 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [268edb0a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:53:17,816 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:20,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:22,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:24,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:27,087 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:27,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [5ab4dee9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:53:27,281 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [5ab4dee9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:53:27,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 35874353 >2012-12-23 13:53:27,308 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] spmStart polling started: taskId = 185e898c-7fe1-4e75-819f-7782db4c95a7 >2012-12-23 13:53:28,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [5ab4dee9] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:53:28,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [5ab4dee9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:28,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] spmStart polling ended: taskId = 185e898c-7fe1-4e75-819f-7782db4c95a7 task status = finished >2012-12-23 13:53:28,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:28,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] spmStart polling ended, spm status: Free >2012-12-23 13:53:28,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=185e898c-7fe1-4e75-819f-7782db4c95a7), log id: 3ecb9baa >2012-12-23 13:53:28,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] FINISH, HSMClearTaskVDSCommand, log id: 3ecb9baa >2012-12-23 13:53:28,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [5ab4dee9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2958d61b, log id: 35874353 >2012-12-23 13:53:28,378 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-14) [7509bd2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:53:28,824 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [7509bd2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:53:29,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:31,205 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:33,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:37,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:38,857 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:53:39,098 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:53:39,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2cf521bb >2012-12-23 13:53:39,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) spmStart polling started: taskId = a5d20fbb-b6cf-4281-bb4b-baa7e10184ba >2012-12-23 13:53:40,159 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:53:40,159 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:40,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) spmStart polling ended: taskId = a5d20fbb-b6cf-4281-bb4b-baa7e10184ba task status = finished >2012-12-23 13:53:40,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:40,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) spmStart polling ended, spm status: Free >2012-12-23 13:53:40,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a5d20fbb-b6cf-4281-bb4b-baa7e10184ba), log id: ac2355f >2012-12-23 13:53:40,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) FINISH, HSMClearTaskVDSCommand, log id: ac2355f >2012-12-23 13:53:40,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@543df57d, log id: 2cf521bb >2012-12-23 13:53:40,202 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-97) [2fc00cc0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:53:41,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:43,672 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [2fc00cc0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:53:45,824 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:48,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:50,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:53,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:53:53,802 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:53:53,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6ffe3be3 >2012-12-23 13:53:53,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) spmStart polling started: taskId = 6ae02706-1b2b-49a7-93e9-85cdb3eb2c2a >2012-12-23 13:53:54,124 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:54,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:53:54,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:54,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) spmStart polling ended: taskId = 6ae02706-1b2b-49a7-93e9-85cdb3eb2c2a task status = finished >2012-12-23 13:53:54,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:53:54,902 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) spmStart polling ended, spm status: Free >2012-12-23 13:53:54,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-12) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6ae02706-1b2b-49a7-93e9-85cdb3eb2c2a), log id: 5e550018 >2012-12-23 13:53:54,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-12) FINISH, HSMClearTaskVDSCommand, log id: 5e550018 >2012-12-23 13:53:54,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1e79580a, log id: 6ffe3be3 >2012-12-23 13:53:54,927 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-12) [30830827] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:53:55,455 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:53:56,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:53:58,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:00,831 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:02,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:04,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:05,483 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:54:05,741 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:54:05,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2f7e87f9 >2012-12-23 13:54:05,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) spmStart polling started: taskId = 7be801fc-ec4b-4b80-ad3b-35f8d3835ae4 >2012-12-23 13:54:06,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-34) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:54:06,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-34) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:06,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) spmStart polling ended: taskId = 7be801fc-ec4b-4b80-ad3b-35f8d3835ae4 task status = finished >2012-12-23 13:54:06,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:06,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) spmStart polling ended, spm status: Free >2012-12-23 13:54:06,811 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-34) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7be801fc-ec4b-4b80-ad3b-35f8d3835ae4), log id: 50b3fede >2012-12-23 13:54:06,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-34) FINISH, HSMClearTaskVDSCommand, log id: 50b3fede >2012-12-23 13:54:06,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5921ca36, log id: 2f7e87f9 >2012-12-23 13:54:06,832 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-34) [3962ccf1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:54:06,909 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [3962ccf1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:54:07,752 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:09,863 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:14,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:16,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:16,939 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:54:17,058 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:54:17,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7edb57f0 >2012-12-23 13:54:17,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) spmStart polling started: taskId = 342a0e5b-154c-40cf-b3c4-6ae8addee690 >2012-12-23 13:54:18,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:54:18,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:18,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) spmStart polling ended: taskId = 342a0e5b-154c-40cf-b3c4-6ae8addee690 task status = finished >2012-12-23 13:54:18,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:18,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) spmStart polling ended, spm status: Free >2012-12-23 13:54:18,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-48) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=342a0e5b-154c-40cf-b3c4-6ae8addee690), log id: 7bcd9d3 >2012-12-23 13:54:18,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-48) FINISH, HSMClearTaskVDSCommand, log id: 7bcd9d3 >2012-12-23 13:54:18,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7f80af9c, log id: 7edb57f0 >2012-12-23 13:54:18,149 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-48) [59896c29] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:54:18,296 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [59896c29] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:54:18,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:20,617 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:22,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:25,396 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:27,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:28,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:54:28,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:54:28,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3d0a606d >2012-12-23 13:54:28,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) spmStart polling started: taskId = be743297-dbab-426b-9497-fcc0876e8a68 >2012-12-23 13:54:29,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:54:29,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:29,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) spmStart polling ended: taskId = be743297-dbab-426b-9497-fcc0876e8a68 task status = finished >2012-12-23 13:54:29,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:29,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) spmStart polling ended, spm status: Free >2012-12-23 13:54:29,509 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=be743297-dbab-426b-9497-fcc0876e8a68), log id: 258d74f1 >2012-12-23 13:54:29,530 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) FINISH, HSMClearTaskVDSCommand, log id: 258d74f1 >2012-12-23 13:54:29,530 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@69f88d79, log id: 3d0a606d >2012-12-23 13:54:29,533 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-61) [3d103949] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:54:30,228 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:30,311 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [3d103949] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:54:32,799 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:34,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:37,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:40,082 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:40,353 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:54:40,646 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:54:40,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 36600e19 >2012-12-23 13:54:40,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) spmStart polling started: taskId = cb704328-c6fb-47c7-a6b6-6e84e48fd8e2 >2012-12-23 13:54:41,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:54:41,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:41,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) spmStart polling ended: taskId = cb704328-c6fb-47c7-a6b6-6e84e48fd8e2 task status = finished >2012-12-23 13:54:41,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:41,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) spmStart polling ended, spm status: Free >2012-12-23 13:54:41,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=cb704328-c6fb-47c7-a6b6-6e84e48fd8e2), log id: 512e958e >2012-12-23 13:54:41,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) FINISH, HSMClearTaskVDSCommand, log id: 512e958e >2012-12-23 13:54:41,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@495cc745, log id: 36600e19 >2012-12-23 13:54:41,741 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:54:41,848 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:54:42,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:44,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:48,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:50,101 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:51,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:54:52,044 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:54:52,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6dec66d4 >2012-12-23 13:54:52,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) spmStart polling started: taskId = 81ce16dd-b02f-4638-8c27-791f24b32b4f >2012-12-23 13:54:52,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:53,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:54:53,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:53,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) spmStart polling ended: taskId = 81ce16dd-b02f-4638-8c27-791f24b32b4f task status = finished >2012-12-23 13:54:53,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:54:53,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) spmStart polling ended, spm status: Free >2012-12-23 13:54:53,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=81ce16dd-b02f-4638-8c27-791f24b32b4f), log id: 7b758345 >2012-12-23 13:54:53,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) FINISH, HSMClearTaskVDSCommand, log id: 7b758345 >2012-12-23 13:54:53,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5ffd6655, log id: 6dec66d4 >2012-12-23 13:54:53,140 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-93) [754987ae] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:54:53,216 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [754987ae] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:54:54,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:56,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:54:58,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts >2012-12-23 13:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering 0 hosts >2012-12-23 13:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Checking autorecoverable hosts done >2012-12-23 13:55:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) Autorecovering storage domains is disabled, skipping >2012-12-23 13:55:00,674 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:02,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:03,247 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:55:03,296 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:55:03,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 457239aa >2012-12-23 13:55:03,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) spmStart polling started: taskId = 53fd2b59-c0c2-4ed3-8253-e00544cfd8a3 >2012-12-23 13:55:04,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:55:04,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:04,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) spmStart polling ended: taskId = 53fd2b59-c0c2-4ed3-8253-e00544cfd8a3 task status = finished >2012-12-23 13:55:04,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:04,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) spmStart polling ended, spm status: Free >2012-12-23 13:55:04,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=53fd2b59-c0c2-4ed3-8253-e00544cfd8a3), log id: 7daec246 >2012-12-23 13:55:04,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) FINISH, HSMClearTaskVDSCommand, log id: 7daec246 >2012-12-23 13:55:04,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5c54c220, log id: 457239aa >2012-12-23 13:55:04,393 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-4) [4094f23b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:55:04,458 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [4094f23b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:55:05,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:07,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:09,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:12,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:14,484 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [37e8149e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:55:14,538 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:14,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [37e8149e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:55:14,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 30068bcc >2012-12-23 13:55:14,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] spmStart polling started: taskId = b0aa2a47-8efb-4454-9e4c-0fb82d722f97 >2012-12-23 13:55:16,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:17,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [37e8149e] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:55:17,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [37e8149e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:17,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] spmStart polling ended: taskId = b0aa2a47-8efb-4454-9e4c-0fb82d722f97 task status = finished >2012-12-23 13:55:17,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:17,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] spmStart polling ended, spm status: Free >2012-12-23 13:55:17,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b0aa2a47-8efb-4454-9e4c-0fb82d722f97), log id: 51b80cae >2012-12-23 13:55:17,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] FINISH, HSMClearTaskVDSCommand, log id: 51b80cae >2012-12-23 13:55:17,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [37e8149e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@a489d6c, log id: 30068bcc >2012-12-23 13:55:17,705 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-20) [255722ba] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:55:18,229 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:55:18,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:20,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:23,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:25,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:28,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:28,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:55:28,283 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:55:28,284 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 53c66411 >2012-12-23 13:55:28,309 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) spmStart polling started: taskId = d49b76de-5af7-49b4-8b14-f7aa7ff9bb61 >2012-12-23 13:55:29,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:55:29,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:29,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) spmStart polling ended: taskId = d49b76de-5af7-49b4-8b14-f7aa7ff9bb61 task status = finished >2012-12-23 13:55:29,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:29,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) spmStart polling ended, spm status: Free >2012-12-23 13:55:29,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-44) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d49b76de-5af7-49b4-8b14-f7aa7ff9bb61), log id: 410b34f8 >2012-12-23 13:55:29,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-44) FINISH, HSMClearTaskVDSCommand, log id: 410b34f8 >2012-12-23 13:55:29,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@46c2a724, log id: 53c66411 >2012-12-23 13:55:29,416 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-44) [156b50c7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:55:29,505 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [156b50c7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:55:30,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:32,818 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:34,940 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:37,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:39,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:55:39,544 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:55:39,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 205b708a >2012-12-23 13:55:39,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) spmStart polling started: taskId = 778d5002-390a-49ec-b8f9-68f12cad374f >2012-12-23 13:55:39,581 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:55:40,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:55:40,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:40,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) spmStart polling ended: taskId = 778d5002-390a-49ec-b8f9-68f12cad374f task status = finished >2012-12-23 13:55:40,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:40,837 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) spmStart polling ended, spm status: Free >2012-12-23 13:55:40,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=778d5002-390a-49ec-b8f9-68f12cad374f), log id: 227a565a >2012-12-23 13:55:40,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) FINISH, HSMClearTaskVDSCommand, log id: 227a565a >2012-12-23 13:55:40,858 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@dbb4065, log id: 205b708a >2012-12-23 13:55:40,863 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [80adee] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:55:40,920 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:55:41,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:44,078 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [3d103949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:46,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:48,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:50,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:50,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:55:51,033 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:55:51,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 53d215de >2012-12-23 13:55:51,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) spmStart polling started: taskId = 7b04af7d-181d-4814-bd9e-f883c7dd6dc6 >2012-12-23 13:55:52,084 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:55:52,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:52,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) spmStart polling ended: taskId = 7b04af7d-181d-4814-bd9e-f883c7dd6dc6 task status = finished >2012-12-23 13:55:52,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:55:52,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) spmStart polling ended, spm status: Free >2012-12-23 13:55:52,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7b04af7d-181d-4814-bd9e-f883c7dd6dc6), log id: 2a465cab >2012-12-23 13:55:52,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) FINISH, HSMClearTaskVDSCommand, log id: 2a465cab >2012-12-23 13:55:52,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@716df43b, log id: 53d215de >2012-12-23 13:55:52,150 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [69bd87aa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:55:52,197 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [69bd87aa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:55:52,770 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:54,824 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:55:57,670 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:55:59,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:02,224 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:56:02,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:56:02,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 34778d87 >2012-12-23 13:56:02,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) spmStart polling started: taskId = 05bfbd28-5a78-4eb7-8141-38b00b73c40c >2012-12-23 13:56:02,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:03,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:56:03,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:03,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) spmStart polling ended: taskId = 05bfbd28-5a78-4eb7-8141-38b00b73c40c task status = finished >2012-12-23 13:56:03,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:03,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) spmStart polling ended, spm status: Free >2012-12-23 13:56:03,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-87) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=05bfbd28-5a78-4eb7-8141-38b00b73c40c), log id: 2d0b20f5 >2012-12-23 13:56:03,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-87) FINISH, HSMClearTaskVDSCommand, log id: 2d0b20f5 >2012-12-23 13:56:03,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@35a0cbed, log id: 34778d87 >2012-12-23 13:56:03,379 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-87) [4fac501c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:56:03,428 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) [4fac501c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:56:04,887 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:07,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:09,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [2fc00cc0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:13,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:13,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:56:13,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:56:13,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 54da0dc8 >2012-12-23 13:56:13,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) spmStart polling started: taskId = 0fcdf068-f570-4d18-bb41-28ac6261ebc8 >2012-12-23 13:56:14,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:56:14,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:14,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) spmStart polling ended: taskId = 0fcdf068-f570-4d18-bb41-28ac6261ebc8 task status = finished >2012-12-23 13:56:14,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:14,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) spmStart polling ended, spm status: Free >2012-12-23 13:56:14,582 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-1) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0fcdf068-f570-4d18-bb41-28ac6261ebc8), log id: 65993cbc >2012-12-23 13:56:14,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-1) FINISH, HSMClearTaskVDSCommand, log id: 65993cbc >2012-12-23 13:56:14,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f628ec0, log id: 54da0dc8 >2012-12-23 13:56:14,618 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-1) [6f89f78d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:56:14,723 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:56:15,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:17,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:19,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:23,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:24,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [619e8886] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:56:25,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:25,685 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [619e8886] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:56:25,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 16a36c96 >2012-12-23 13:56:25,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] spmStart polling started: taskId = 085e428b-3740-4f8f-aca5-088fdb9a0b3b >2012-12-23 13:56:26,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [619e8886] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:56:26,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [619e8886] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:26,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] spmStart polling ended: taskId = 085e428b-3740-4f8f-aca5-088fdb9a0b3b task status = finished >2012-12-23 13:56:26,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:26,770 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] spmStart polling ended, spm status: Free >2012-12-23 13:56:26,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [619e8886] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=085e428b-3740-4f8f-aca5-088fdb9a0b3b), log id: 1d479815 >2012-12-23 13:56:26,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [619e8886] FINISH, HSMClearTaskVDSCommand, log id: 1d479815 >2012-12-23 13:56:26,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [619e8886] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@475199b7, log id: 16a36c96 >2012-12-23 13:56:26,796 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [3e42e1f5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:56:26,968 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3e42e1f5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:56:27,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:29,881 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:33,535 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:35,676 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:36,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [3962ccf1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:56:37,008 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [3962ccf1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:56:37,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 112e6b9d >2012-12-23 13:56:37,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] spmStart polling started: taskId = e0301c5e-cd2a-4642-b253-dd66c60a19e4 >2012-12-23 13:56:37,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:39,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [60ee1ac1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 13:56:40,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-34) [3962ccf1] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:56:40,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-34) [3962ccf1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:40,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] spmStart polling ended: taskId = e0301c5e-cd2a-4642-b253-dd66c60a19e4 task status = finished >2012-12-23 13:56:40,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:40,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] spmStart polling ended, spm status: Free >2012-12-23 13:56:40,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e0301c5e-cd2a-4642-b253-dd66c60a19e4), log id: 5c7880eb >2012-12-23 13:56:40,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] FINISH, HSMClearTaskVDSCommand, log id: 5c7880eb >2012-12-23 13:56:40,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-34) [3962ccf1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6b57f3ba, log id: 112e6b9d >2012-12-23 13:56:40,650 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-34) [5b426f64] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:56:41,056 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:56:42,843 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:44,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:47,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:49,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:51,085 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:56:51,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:56:51,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 65121009 >2012-12-23 13:56:51,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) spmStart polling started: taskId = 3469b9bd-255b-4cd0-a079-00bca7a90868 >2012-12-23 13:56:52,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:56:52,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:52,167 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) spmStart polling ended: taskId = 3469b9bd-255b-4cd0-a079-00bca7a90868 task status = finished >2012-12-23 13:56:52,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:56:52,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) spmStart polling ended, spm status: Free >2012-12-23 13:56:52,193 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3469b9bd-255b-4cd0-a079-00bca7a90868), log id: 6c42d9f8 >2012-12-23 13:56:52,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) FINISH, HSMClearTaskVDSCommand, log id: 6c42d9f8 >2012-12-23 13:56:52,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@18f4604f, log id: 65121009 >2012-12-23 13:56:52,221 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-55) [53deef55] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:56:52,277 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:56:52,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:54,824 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:57,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [3d103949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:56:59,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:02,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:02,337 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:02,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 52319c1f >2012-12-23 13:57:02,361 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) spmStart polling started: taskId = 08ed6410-1b6b-42e3-846c-879819972fbd >2012-12-23 13:57:02,679 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:03,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-67) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:57:03,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-67) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:03,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) spmStart polling ended: taskId = 08ed6410-1b6b-42e3-846c-879819972fbd task status = finished >2012-12-23 13:57:03,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:03,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) spmStart polling ended, spm status: Free >2012-12-23 13:57:03,404 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-67) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=08ed6410-1b6b-42e3-846c-879819972fbd), log id: 711a9108 >2012-12-23 13:57:03,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-67) FINISH, HSMClearTaskVDSCommand, log id: 711a9108 >2012-12-23 13:57:03,431 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-67) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@727de3b, log id: 52319c1f >2012-12-23 13:57:03,435 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-67) [4a6ef728] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:57:03,512 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:57:04,716 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:07,951 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [69bd87aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:10,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:12,685 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:13,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:13,554 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:13,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 36c814d1 >2012-12-23 13:57:13,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) spmStart polling started: taskId = c3907c40-f3a6-40d4-8ee5-67578cfea479 >2012-12-23 13:57:14,601 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:57:14,602 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:14,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) spmStart polling ended: taskId = c3907c40-f3a6-40d4-8ee5-67578cfea479 task status = finished >2012-12-23 13:57:14,602 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:14,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) spmStart polling ended, spm status: Free >2012-12-23 13:57:14,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c3907c40-f3a6-40d4-8ee5-67578cfea479), log id: 4e549ad8 >2012-12-23 13:57:14,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) FINISH, HSMClearTaskVDSCommand, log id: 4e549ad8 >2012-12-23 13:57:14,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@14820315, log id: 36c814d1 >2012-12-23 13:57:14,645 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-79) [63986237] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:57:14,793 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:15,608 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:57:17,648 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [4fac501c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:19,814 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:22,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:24,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:25,636 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [2fc00cc0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:25,739 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [2fc00cc0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:25,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 22f61657 >2012-12-23 13:57:25,766 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] spmStart polling started: taskId = 02c2ca4c-ae57-480b-a98a-06ee09d68d29 >2012-12-23 13:57:26,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [2fc00cc0] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:57:26,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [2fc00cc0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:26,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] spmStart polling ended: taskId = 02c2ca4c-ae57-480b-a98a-06ee09d68d29 task status = finished >2012-12-23 13:57:26,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:26,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] spmStart polling ended, spm status: Free >2012-12-23 13:57:26,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=02c2ca4c-ae57-480b-a98a-06ee09d68d29), log id: 295c1ce4 >2012-12-23 13:57:26,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] FINISH, HSMClearTaskVDSCommand, log id: 295c1ce4 >2012-12-23 13:57:26,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [2fc00cc0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5e6cd1f2, log id: 22f61657 >2012-12-23 13:57:26,833 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-97) [3a4b974c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:57:26,932 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [3a4b974c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:57:27,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:29,654 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:31,856 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:34,064 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:36,124 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:36,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:36,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:36,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 577ed335 >2012-12-23 13:57:37,020 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) spmStart polling started: taskId = 15469887-8746-40d0-a8e8-48e7bd032df9 >2012-12-23 13:57:38,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:57:38,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:38,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) spmStart polling ended: taskId = 15469887-8746-40d0-a8e8-48e7bd032df9 task status = finished >2012-12-23 13:57:38,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:38,078 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) spmStart polling ended, spm status: Free >2012-12-23 13:57:38,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-15) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=15469887-8746-40d0-a8e8-48e7bd032df9), log id: 6febcbd >2012-12-23 13:57:38,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-15) FINISH, HSMClearTaskVDSCommand, log id: 6febcbd >2012-12-23 13:57:38,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3e191fe1, log id: 577ed335 >2012-12-23 13:57:38,102 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [637c0ca0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:57:38,180 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [637c0ca0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:57:38,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:40,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:43,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3e42e1f5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:45,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:47,941 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:48,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:48,235 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:48,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3cf4a875 >2012-12-23 13:57:48,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) spmStart polling started: taskId = 46afcfae-4429-483e-be38-d15ec66bede4 >2012-12-23 13:57:49,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:57:49,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:49,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) spmStart polling ended: taskId = 46afcfae-4429-483e-be38-d15ec66bede4 task status = finished >2012-12-23 13:57:49,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:57:49,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) spmStart polling ended, spm status: Free >2012-12-23 13:57:49,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=46afcfae-4429-483e-be38-d15ec66bede4), log id: 657e3318 >2012-12-23 13:57:49,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) FINISH, HSMClearTaskVDSCommand, log id: 657e3318 >2012-12-23 13:57:49,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@404ca0b6, log id: 3cf4a875 >2012-12-23 13:57:49,326 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-27) [66cb2db4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:57:49,372 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [66cb2db4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:57:50,026 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:52,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:54,784 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:57,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [156b50c7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:57:59,401 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:57:59,425 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:57:59,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6475cb04 >2012-12-23 13:57:59,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) spmStart polling started: taskId = db77f2bc-671a-41c1-bf09-21c7c72ed142 >2012-12-23 13:57:59,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:01,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:01,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:01,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) spmStart polling ended: taskId = db77f2bc-671a-41c1-bf09-21c7c72ed142 task status = finished >2012-12-23 13:58:01,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:01,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) spmStart polling ended, spm status: Free >2012-12-23 13:58:01,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=db77f2bc-671a-41c1-bf09-21c7c72ed142), log id: 40682710 >2012-12-23 13:58:01,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) FINISH, HSMClearTaskVDSCommand, log id: 40682710 >2012-12-23 13:58:01,554 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75dcac78, log id: 6475cb04 >2012-12-23 13:58:01,556 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-42) [6abf36bb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:02,137 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [6abf36bb] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:58:02,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:04,697 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:07,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:09,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:12,164 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:58:12,208 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:58:12,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 63369f8d >2012-12-23 13:58:12,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) spmStart polling started: taskId = 5c890d26-012e-460e-bf1e-1e24a9788fc1 >2012-12-23 13:58:13,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:13,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:13,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:13,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) spmStart polling ended: taskId = 5c890d26-012e-460e-bf1e-1e24a9788fc1 task status = finished >2012-12-23 13:58:13,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:13,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) spmStart polling ended, spm status: Free >2012-12-23 13:58:13,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-60) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5c890d26-012e-460e-bf1e-1e24a9788fc1), log id: 48b8dc7b >2012-12-23 13:58:13,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-60) FINISH, HSMClearTaskVDSCommand, log id: 48b8dc7b >2012-12-23 13:58:13,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@60933489, log id: 63369f8d >2012-12-23 13:58:13,304 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-60) [605e3fe7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:13,482 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:58:15,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:18,319 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:20,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [268edb0a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:23,027 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:23,510 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [69bd87aa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:58:23,541 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [69bd87aa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:58:23,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 29f71326 >2012-12-23 13:58:23,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] spmStart polling started: taskId = 8250f20a-4396-44a8-9b45-10e8ab17f432 >2012-12-23 13:58:24,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [69bd87aa] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:24,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [69bd87aa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:24,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] spmStart polling ended: taskId = 8250f20a-4396-44a8-9b45-10e8ab17f432 task status = finished >2012-12-23 13:58:24,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:24,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] spmStart polling ended, spm status: Free >2012-12-23 13:58:24,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8250f20a-4396-44a8-9b45-10e8ab17f432), log id: 2624443c >2012-12-23 13:58:24,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] FINISH, HSMClearTaskVDSCommand, log id: 2624443c >2012-12-23 13:58:24,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [69bd87aa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@16fbd2b4, log id: 29f71326 >2012-12-23 13:58:24,631 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [6ec63335] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:24,725 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:58:25,060 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:27,399 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:29,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:31,625 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:33,741 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:34,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) [4fac501c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:58:35,430 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) [4fac501c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:58:35,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 366a5fb7 >2012-12-23 13:58:35,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] spmStart polling started: taskId = 74a454db-1151-4a54-b76c-d5566d187d99 >2012-12-23 13:58:35,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:36,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) [4fac501c] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:36,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-87) [4fac501c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:36,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] spmStart polling ended: taskId = 74a454db-1151-4a54-b76c-d5566d187d99 task status = finished >2012-12-23 13:58:36,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:36,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] spmStart polling ended, spm status: Free >2012-12-23 13:58:36,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=74a454db-1151-4a54-b76c-d5566d187d99), log id: b6abb81 >2012-12-23 13:58:36,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] FINISH, HSMClearTaskVDSCommand, log id: b6abb81 >2012-12-23 13:58:36,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-87) [4fac501c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@c3c1802, log id: 366a5fb7 >2012-12-23 13:58:36,567 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-87) [3d4c3194] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:36,648 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:58:38,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:40,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:42,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [3a4b974c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:44,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:46,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [4094f23b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:58:46,704 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [4094f23b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:58:46,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7c0b52a1 >2012-12-23 13:58:46,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] spmStart polling started: taskId = b2a933b4-7ee1-41e3-b404-7c2ed5b26bd7 >2012-12-23 13:58:47,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:47,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [4094f23b] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:47,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [4094f23b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:47,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] spmStart polling ended: taskId = b2a933b4-7ee1-41e3-b404-7c2ed5b26bd7 task status = finished >2012-12-23 13:58:47,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:47,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] spmStart polling ended, spm status: Free >2012-12-23 13:58:47,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b2a933b4-7ee1-41e3-b404-7c2ed5b26bd7), log id: 8292f59 >2012-12-23 13:58:47,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] FINISH, HSMClearTaskVDSCommand, log id: 8292f59 >2012-12-23 13:58:47,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [4094f23b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@47e3803e, log id: 7c0b52a1 >2012-12-23 13:58:47,797 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-4) [28f88b51] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:47,887 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:58:49,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:52,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:54,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:57,911 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:58:57,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:58:57,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:58:57,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6b7ccbf >2012-12-23 13:58:57,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) spmStart polling started: taskId = 5753bc20-a9e2-47d0-b266-31f90cb5c52e >2012-12-23 13:58:59,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:58:59,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:59,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) spmStart polling ended: taskId = 5753bc20-a9e2-47d0-b266-31f90cb5c52e task status = finished >2012-12-23 13:58:59,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:58:59,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) spmStart polling ended, spm status: Free >2012-12-23 13:58:59,038 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-25) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5753bc20-a9e2-47d0-b266-31f90cb5c52e), log id: 41d77455 >2012-12-23 13:58:59,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-25) FINISH, HSMClearTaskVDSCommand, log id: 41d77455 >2012-12-23 13:58:59,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@28169a38, log id: 6b7ccbf >2012-12-23 13:58:59,068 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-25) [63e6e717] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:58:59,164 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:00,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:02,710 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:04,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:07,140 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:09,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:09,202 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [60ee1ac1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:59:09,360 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [60ee1ac1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:59:09,386 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1330f48b >2012-12-23 13:59:09,409 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] spmStart polling started: taskId = c92ea419-64ea-4860-a012-c9b538dc8d96 >2012-12-23 13:59:10,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [60ee1ac1] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:59:10,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [60ee1ac1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:10,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] spmStart polling ended: taskId = c92ea419-64ea-4860-a012-c9b538dc8d96 task status = finished >2012-12-23 13:59:10,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:10,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] spmStart polling ended, spm status: Free >2012-12-23 13:59:10,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c92ea419-64ea-4860-a012-c9b538dc8d96), log id: f961ff3 >2012-12-23 13:59:10,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] FINISH, HSMClearTaskVDSCommand, log id: f961ff3 >2012-12-23 13:59:10,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [60ee1ac1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@490b9283, log id: 1330f48b >2012-12-23 13:59:10,476 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [16bffbec] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:59:11,069 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:11,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:13,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:15,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [6abf36bb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:17,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:19,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:21,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [12c423b8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:59:21,111 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [12c423b8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:59:21,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 55c3c719 >2012-12-23 13:59:21,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] spmStart polling started: taskId = 8c54d333-4da7-4c3a-9851-cfa5857d5034 >2012-12-23 13:59:21,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:23,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [12c423b8] Failed in HSMGetTaskStatusVDS method >2012-12-23 13:59:23,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [12c423b8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:23,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] spmStart polling ended: taskId = 8c54d333-4da7-4c3a-9851-cfa5857d5034 task status = finished >2012-12-23 13:59:23,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:23,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] spmStart polling ended, spm status: Free >2012-12-23 13:59:23,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8c54d333-4da7-4c3a-9851-cfa5857d5034), log id: 31ae5467 >2012-12-23 13:59:23,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] FINISH, HSMClearTaskVDSCommand, log id: 31ae5467 >2012-12-23 13:59:23,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [12c423b8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c274fac, log id: 55c3c719 >2012-12-23 13:59:23,261 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [48dfbbd9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:59:23,327 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [48dfbbd9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:23,893 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:26,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:28,069 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:30,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:32,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:33,354 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:59:33,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:59:33,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1f915cec >2012-12-23 13:59:33,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) spmStart polling started: taskId = 0a25d800-65b6-467e-899e-2426c107c6b7 >2012-12-23 13:59:34,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:59:34,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:34,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) spmStart polling ended: taskId = 0a25d800-65b6-467e-899e-2426c107c6b7 task status = finished >2012-12-23 13:59:34,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:34,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) spmStart polling ended, spm status: Free >2012-12-23 13:59:34,439 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0a25d800-65b6-467e-899e-2426c107c6b7), log id: ffebe34 >2012-12-23 13:59:34,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) FINISH, HSMClearTaskVDSCommand, log id: ffebe34 >2012-12-23 13:59:34,458 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1d795020, log id: 1f915cec >2012-12-23 13:59:34,461 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-72) [77b73fe] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:59:34,485 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [77b73fe] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:34,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [268edb0a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:36,771 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:39,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:41,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:43,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:44,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:59:44,528 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:59:44,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4231dd4c >2012-12-23 13:59:44,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) spmStart polling started: taskId = a7cc5f66-4016-49a7-aabd-2ede48c12d4a >2012-12-23 13:59:45,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:59:45,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:45,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) spmStart polling ended: taskId = a7cc5f66-4016-49a7-aabd-2ede48c12d4a task status = finished >2012-12-23 13:59:45,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:45,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) spmStart polling ended, spm status: Free >2012-12-23 13:59:45,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a7cc5f66-4016-49a7-aabd-2ede48c12d4a), log id: 50757376 >2012-12-23 13:59:45,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) FINISH, HSMClearTaskVDSCommand, log id: 50757376 >2012-12-23 13:59:45,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4eef713e, log id: 4231dd4c >2012-12-23 13:59:45,618 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-81) [49f3c5ee] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:59:45,649 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:45,693 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:47,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:49,815 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:52,855 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:54,922 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:55,675 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 13:59:55,687 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 13:59:55,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 28a412d1 >2012-12-23 13:59:55,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) spmStart polling started: taskId = da85a81c-b381-44e0-a1ff-d0176344cfdd >2012-12-23 13:59:56,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) Failed in HSMGetTaskStatusVDS method >2012-12-23 13:59:56,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:56,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) spmStart polling ended: taskId = da85a81c-b381-44e0-a1ff-d0176344cfdd task status = finished >2012-12-23 13:59:56,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 13:59:56,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) spmStart polling ended, spm status: Free >2012-12-23 13:59:56,780 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=da85a81c-b381-44e0-a1ff-d0176344cfdd), log id: 152e7b >2012-12-23 13:59:56,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) FINISH, HSMClearTaskVDSCommand, log id: 152e7b >2012-12-23 13:59:56,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6e9e8d47, log id: 28a412d1 >2012-12-23 13:59:56,802 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-84) [6b4d690d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 13:59:56,829 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 13:59:57,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 13:59:59,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts >2012-12-23 14:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering 0 hosts >2012-12-23 14:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Checking autorecoverable hosts done >2012-12-23 14:00:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-8) Autorecovering storage domains is disabled, skipping >2012-12-23 14:00:01,724 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:00:03,843 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:00:05,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:00:06,859 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:00:06,876 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:00:06,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: aa99eba >2012-12-23 14:00:06,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) spmStart polling started: taskId = ef3d2c39-5627-4ac3-a27d-5250ba1c275c >2012-12-23 14:00:07,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:00:07,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:07,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) spmStart polling ended: taskId = ef3d2c39-5627-4ac3-a27d-5250ba1c275c task status = finished >2012-12-23 14:00:07,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:07,945 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3e42e1f5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:00:07,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) spmStart polling ended, spm status: Free >2012-12-23 14:00:07,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ef3d2c39-5627-4ac3-a27d-5250ba1c275c), log id: 35cc70b1 >2012-12-23 14:00:07,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) FINISH, HSMClearTaskVDSCommand, log id: 35cc70b1 >2012-12-23 14:00:07,982 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@fa900f, log id: aa99eba >2012-12-23 14:00:07,984 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-23) [4207c949] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:00:08,445 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:00:18,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [66cb2db4] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:00:18,521 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [66cb2db4] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:00:18,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3a1d3fb5 >2012-12-23 14:00:18,547 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] spmStart polling started: taskId = 0f278d2e-f6ce-448f-b512-8a00fd281025 >2012-12-23 14:00:19,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [66cb2db4] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:00:19,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [66cb2db4] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:19,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] spmStart polling ended: taskId = 0f278d2e-f6ce-448f-b512-8a00fd281025 task status = finished >2012-12-23 14:00:19,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:19,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] spmStart polling ended, spm status: Free >2012-12-23 14:00:19,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0f278d2e-f6ce-448f-b512-8a00fd281025), log id: 36dee833 >2012-12-23 14:00:19,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] FINISH, HSMClearTaskVDSCommand, log id: 36dee833 >2012-12-23 14:00:19,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [66cb2db4] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@11c5ca45, log id: 3a1d3fb5 >2012-12-23 14:00:19,643 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-27) [50628120] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:00:19,714 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [50628120] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:00:29,745 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:00:29,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:00:29,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 585078bb >2012-12-23 14:00:29,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) spmStart polling started: taskId = bc296bd8-844b-4a4b-8a9d-72fe2ee74315 >2012-12-23 14:00:30,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:00:30,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:30,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) spmStart polling ended: taskId = bc296bd8-844b-4a4b-8a9d-72fe2ee74315 task status = finished >2012-12-23 14:00:30,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:30,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) spmStart polling ended, spm status: Free >2012-12-23 14:00:30,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bc296bd8-844b-4a4b-8a9d-72fe2ee74315), log id: d29c080 >2012-12-23 14:00:30,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) FINISH, HSMClearTaskVDSCommand, log id: d29c080 >2012-12-23 14:00:30,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@301d1a40, log id: 585078bb >2012-12-23 14:00:30,853 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-39) [46a6786d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:00:30,932 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [46a6786d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:00:40,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:00:41,065 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:00:41,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 136acda9 >2012-12-23 14:00:41,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) spmStart polling started: taskId = 440ebacc-91dc-4796-8b6b-4ef98ac3948b >2012-12-23 14:00:42,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:00:42,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-57) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:42,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) spmStart polling ended: taskId = 440ebacc-91dc-4796-8b6b-4ef98ac3948b task status = finished >2012-12-23 14:00:42,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:42,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) spmStart polling ended, spm status: Free >2012-12-23 14:00:42,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-57) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=440ebacc-91dc-4796-8b6b-4ef98ac3948b), log id: 51f79322 >2012-12-23 14:00:42,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-57) FINISH, HSMClearTaskVDSCommand, log id: 51f79322 >2012-12-23 14:00:42,334 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-57) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@54dcc738, log id: 136acda9 >2012-12-23 14:00:42,337 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-57) [6a9b590e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:00:42,424 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:00:52,467 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [3d103949] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:00:52,529 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [3d103949] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:00:52,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 735211d6 >2012-12-23 14:00:52,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] spmStart polling started: taskId = 67da6a0a-3623-4c71-879b-16dccde2f1f7 >2012-12-23 14:00:53,590 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [3d103949] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:00:53,590 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [3d103949] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:53,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] spmStart polling ended: taskId = 67da6a0a-3623-4c71-879b-16dccde2f1f7 task status = finished >2012-12-23 14:00:53,591 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:00:53,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] spmStart polling ended, spm status: Free >2012-12-23 14:00:53,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [3d103949] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=67da6a0a-3623-4c71-879b-16dccde2f1f7), log id: 4b871d28 >2012-12-23 14:00:53,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [3d103949] FINISH, HSMClearTaskVDSCommand, log id: 4b871d28 >2012-12-23 14:00:53,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [3d103949] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@138b53d5, log id: 735211d6 >2012-12-23 14:00:53,634 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-61) [202ccef9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:00:53,750 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:01:03,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [268edb0a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:01:03,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [268edb0a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:01:03,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6247f24c >2012-12-23 14:01:03,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] spmStart polling started: taskId = 331fb54a-d23c-4ba7-872a-5cfbb02b2743 >2012-12-23 14:01:06,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [268edb0a] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:01:06,953 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [268edb0a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:06,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] spmStart polling ended: taskId = 331fb54a-d23c-4ba7-872a-5cfbb02b2743 task status = finished >2012-12-23 14:01:06,953 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:06,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] spmStart polling ended, spm status: Free >2012-12-23 14:01:06,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=331fb54a-d23c-4ba7-872a-5cfbb02b2743), log id: 81dd65b >2012-12-23 14:01:06,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] FINISH, HSMClearTaskVDSCommand, log id: 81dd65b >2012-12-23 14:01:06,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [268edb0a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5ee3f486, log id: 6247f24c >2012-12-23 14:01:06,995 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-69) [47caba15] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:01:07,078 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:01:17,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [7509bd2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:01:17,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [7509bd2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:01:17,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 438ca1b6 >2012-12-23 14:01:17,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] spmStart polling started: taskId = d2bcdae5-ef87-4df4-a90d-3be0a69a8c49 >2012-12-23 14:01:18,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [7509bd2] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:01:18,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [7509bd2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:18,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] spmStart polling ended: taskId = d2bcdae5-ef87-4df4-a90d-3be0a69a8c49 task status = finished >2012-12-23 14:01:18,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:18,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] spmStart polling ended, spm status: Free >2012-12-23 14:01:18,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d2bcdae5-ef87-4df4-a90d-3be0a69a8c49), log id: 57c53bf1 >2012-12-23 14:01:18,241 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] FINISH, HSMClearTaskVDSCommand, log id: 57c53bf1 >2012-12-23 14:01:18,241 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [7509bd2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@55e2783b, log id: 438ca1b6 >2012-12-23 14:01:18,245 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-14) [743958a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:01:18,313 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:01:28,340 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:01:28,618 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:01:28,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3234c948 >2012-12-23 14:01:28,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) spmStart polling started: taskId = 892b1e6f-6461-4c5e-98a0-816a045625b8 >2012-12-23 14:01:29,669 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:01:29,669 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:29,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) spmStart polling ended: taskId = 892b1e6f-6461-4c5e-98a0-816a045625b8 task status = finished >2012-12-23 14:01:29,669 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:29,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) spmStart polling ended, spm status: Free >2012-12-23 14:01:29,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=892b1e6f-6461-4c5e-98a0-816a045625b8), log id: 43e55bb0 >2012-12-23 14:01:29,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) FINISH, HSMClearTaskVDSCommand, log id: 43e55bb0 >2012-12-23 14:01:29,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6e6a2a3, log id: 3234c948 >2012-12-23 14:01:29,712 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-95) [fbf7edf] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:01:29,805 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:01:39,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:01:40,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:01:40,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 54c7eee6 >2012-12-23 14:01:40,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) spmStart polling started: taskId = c48603b8-87e4-4c22-b8ed-0a3733548a42 >2012-12-23 14:01:41,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:01:41,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:41,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) spmStart polling ended: taskId = c48603b8-87e4-4c22-b8ed-0a3733548a42 task status = finished >2012-12-23 14:01:41,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:41,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) spmStart polling ended, spm status: Free >2012-12-23 14:01:41,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c48603b8-87e4-4c22-b8ed-0a3733548a42), log id: 477afd55 >2012-12-23 14:01:41,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) FINISH, HSMClearTaskVDSCommand, log id: 477afd55 >2012-12-23 14:01:41,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5b8dfc1c, log id: 54c7eee6 >2012-12-23 14:01:41,355 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-5) [46a2c139] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:01:41,382 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [46a2c139] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:01:51,409 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:01:51,442 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:01:51,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6484ebb >2012-12-23 14:01:51,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) spmStart polling started: taskId = 7d8c7e03-bc3c-4fe2-93f6-eda4c715ec56 >2012-12-23 14:01:52,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:01:52,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:52,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) spmStart polling ended: taskId = 7d8c7e03-bc3c-4fe2-93f6-eda4c715ec56 task status = finished >2012-12-23 14:01:52,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:01:52,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) spmStart polling ended, spm status: Free >2012-12-23 14:01:52,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7d8c7e03-bc3c-4fe2-93f6-eda4c715ec56), log id: 123ba6e9 >2012-12-23 14:01:52,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) FINISH, HSMClearTaskVDSCommand, log id: 123ba6e9 >2012-12-23 14:01:52,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@a4b1459, log id: 6484ebb >2012-12-23 14:01:52,531 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [4724e456] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:01:52,656 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4724e456] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:02:02,684 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:02:02,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:02:02,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 780bb213 >2012-12-23 14:02:02,761 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) spmStart polling started: taskId = 0e5e6f23-e6e7-4809-a14c-c40c5b00c001 >2012-12-23 14:02:08,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:02:08,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:08,923 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) spmStart polling ended: taskId = 0e5e6f23-e6e7-4809-a14c-c40c5b00c001 task status = finished >2012-12-23 14:02:08,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:08,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) spmStart polling ended, spm status: Free >2012-12-23 14:02:08,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0e5e6f23-e6e7-4809-a14c-c40c5b00c001), log id: 521ebb28 >2012-12-23 14:02:08,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) FINISH, HSMClearTaskVDSCommand, log id: 521ebb28 >2012-12-23 14:02:08,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5f916936, log id: 780bb213 >2012-12-23 14:02:08,964 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [4392893e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:02:09,003 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [4392893e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:02:19,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [156b50c7] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:02:19,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [156b50c7] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:02:19,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 859ff23 >2012-12-23 14:02:19,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] spmStart polling started: taskId = 7b1a2cac-74b1-4293-94dd-7013e9934a8f >2012-12-23 14:02:20,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [156b50c7] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:02:20,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-44) [156b50c7] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:20,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] spmStart polling ended: taskId = 7b1a2cac-74b1-4293-94dd-7013e9934a8f task status = finished >2012-12-23 14:02:20,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:20,124 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] spmStart polling ended, spm status: Free >2012-12-23 14:02:20,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7b1a2cac-74b1-4293-94dd-7013e9934a8f), log id: 2dcf9c76 >2012-12-23 14:02:20,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] FINISH, HSMClearTaskVDSCommand, log id: 2dcf9c76 >2012-12-23 14:02:20,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-44) [156b50c7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@19291e79, log id: 859ff23 >2012-12-23 14:02:20,147 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:02:21,373 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:02:31,402 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:02:31,610 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [6bc5753c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:02:31,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 29da495f >2012-12-23 14:02:31,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] spmStart polling started: taskId = 1652eae9-05ce-4821-8cd3-9c1dea1647eb >2012-12-23 14:02:32,660 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [6bc5753c] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:02:32,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [6bc5753c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:32,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] spmStart polling ended: taskId = 1652eae9-05ce-4821-8cd3-9c1dea1647eb task status = finished >2012-12-23 14:02:32,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:32,679 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] spmStart polling ended, spm status: Free >2012-12-23 14:02:32,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1652eae9-05ce-4821-8cd3-9c1dea1647eb), log id: 7edc465e >2012-12-23 14:02:32,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] FINISH, HSMClearTaskVDSCommand, log id: 7edc465e >2012-12-23 14:02:32,700 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [6bc5753c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f900663, log id: 29da495f >2012-12-23 14:02:32,702 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-47) [189365fa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:02:32,815 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [189365fa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:02:42,845 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:02:42,881 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:02:42,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 44f88e70 >2012-12-23 14:02:42,905 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) spmStart polling started: taskId = 1a5afce2-711d-4ab9-9ad1-5a2effad9588 >2012-12-23 14:02:43,929 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-70) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:02:43,929 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-70) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:43,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) spmStart polling ended: taskId = 1a5afce2-711d-4ab9-9ad1-5a2effad9588 task status = finished >2012-12-23 14:02:43,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:43,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) spmStart polling ended, spm status: Free >2012-12-23 14:02:43,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-70) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1a5afce2-711d-4ab9-9ad1-5a2effad9588), log id: 9f1c1cb >2012-12-23 14:02:43,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-70) FINISH, HSMClearTaskVDSCommand, log id: 9f1c1cb >2012-12-23 14:02:43,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-70) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5ee9fb86, log id: 44f88e70 >2012-12-23 14:02:43,978 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-70) [53804b18] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:02:44,027 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:02:46,084 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-11) Checking if user admin@internal is an admin, result true >2012-12-23 14:02:46,085 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginAdminUserCommand internal: false. >2012-12-23 14:02:54,053 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:02:54,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:02:54,119 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 79a1ef96 >2012-12-23 14:02:54,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] spmStart polling started: taskId = 005c8329-fd74-46d7-8757-a154e066ebd0 >2012-12-23 14:02:55,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [6a1ea8a3] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:02:55,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [6a1ea8a3] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:55,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] spmStart polling ended: taskId = 005c8329-fd74-46d7-8757-a154e066ebd0 task status = finished >2012-12-23 14:02:55,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:02:55,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] spmStart polling ended, spm status: Free >2012-12-23 14:02:55,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=005c8329-fd74-46d7-8757-a154e066ebd0), log id: 407c3b19 >2012-12-23 14:02:55,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] FINISH, HSMClearTaskVDSCommand, log id: 407c3b19 >2012-12-23 14:02:55,501 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a1ea8a3] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1c0c0762, log id: 79a1ef96 >2012-12-23 14:02:55,504 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [59b8c150] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:02:56,643 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [59b8c150] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:06,669 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:03:06,685 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:03:06,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 79eb19d3 >2012-12-23 14:03:06,723 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) spmStart polling started: taskId = 8c085199-eadc-413d-a996-089d1fd14d99 >2012-12-23 14:03:10,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 14:03:10,813 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:03:10,813 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:10,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) spmStart polling ended: taskId = 8c085199-eadc-413d-a996-089d1fd14d99 task status = finished >2012-12-23 14:03:10,813 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:10,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) spmStart polling ended, spm status: Free >2012-12-23 14:03:10,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8c085199-eadc-413d-a996-089d1fd14d99), log id: 84e912a >2012-12-23 14:03:10,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) FINISH, HSMClearTaskVDSCommand, log id: 84e912a >2012-12-23 14:03:10,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5e1c60a8, log id: 79eb19d3 >2012-12-23 14:03:10,864 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-91) [190de5dd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:03:10,889 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [190de5dd] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:12,591 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:14,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:16,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:18,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:20,920 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [46a2c139] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:03:20,957 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [46a2c139] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:03:20,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4b9a985a >2012-12-23 14:03:20,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] spmStart polling started: taskId = 08d78dca-265e-4cff-a2cd-7f40b2639e09 >2012-12-23 14:03:21,023 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:22,003 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [46a2c139] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:03:22,003 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [46a2c139] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:22,003 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] spmStart polling ended: taskId = 08d78dca-265e-4cff-a2cd-7f40b2639e09 task status = finished >2012-12-23 14:03:22,003 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:22,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] spmStart polling ended, spm status: Free >2012-12-23 14:03:22,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=08d78dca-265e-4cff-a2cd-7f40b2639e09), log id: 477ca883 >2012-12-23 14:03:22,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] FINISH, HSMClearTaskVDSCommand, log id: 477ca883 >2012-12-23 14:03:22,042 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [46a2c139] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@491b551f, log id: 4b9a985a >2012-12-23 14:03:22,044 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-5) [21718bb8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:03:22,092 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:23,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:25,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:28,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:30,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:32,170 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3e42e1f5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:03:32,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3e42e1f5] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:03:32,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 41ec155e >2012-12-23 14:03:32,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] spmStart polling started: taskId = b984b342-ab38-4ce9-b295-909958699527 >2012-12-23 14:03:33,032 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:33,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3e42e1f5] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:03:33,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3e42e1f5] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:33,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] spmStart polling ended: taskId = b984b342-ab38-4ce9-b295-909958699527 task status = finished >2012-12-23 14:03:33,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:33,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] spmStart polling ended, spm status: Free >2012-12-23 14:03:33,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b984b342-ab38-4ce9-b295-909958699527), log id: 12e70f6e >2012-12-23 14:03:33,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] FINISH, HSMClearTaskVDSCommand, log id: 12e70f6e >2012-12-23 14:03:33,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3e42e1f5] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7fa60873, log id: 41ec155e >2012-12-23 14:03:33,308 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [6d74f77d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:03:33,353 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [6d74f77d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:35,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:37,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:39,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [50628120] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:42,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:43,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:03:43,411 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:03:43,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5b86c628 >2012-12-23 14:03:43,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) spmStart polling started: taskId = a3193e0c-e420-43ef-b37f-758356fa12f0 >2012-12-23 14:03:44,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:44,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:03:44,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:44,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) spmStart polling ended: taskId = a3193e0c-e420-43ef-b37f-758356fa12f0 task status = finished >2012-12-23 14:03:44,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:44,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) spmStart polling ended, spm status: Free >2012-12-23 14:03:44,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a3193e0c-e420-43ef-b37f-758356fa12f0), log id: 6a1e5d5e >2012-12-23 14:03:44,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) FINISH, HSMClearTaskVDSCommand, log id: 6a1e5d5e >2012-12-23 14:03:44,507 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@52ab50aa, log id: 5b86c628 >2012-12-23 14:03:44,509 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [6d3cf34c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:03:44,575 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [6d3cf34c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:46,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:48,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [59896c29] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:50,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:53,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:54,619 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:03:54,654 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:03:54,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 19d5d4dc >2012-12-23 14:03:54,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) spmStart polling started: taskId = b825a3ad-0bbe-408f-a786-343dde0f92c5 >2012-12-23 14:03:55,109 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:03:55,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:03:55,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:55,702 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) spmStart polling ended: taskId = b825a3ad-0bbe-408f-a786-343dde0f92c5 task status = finished >2012-12-23 14:03:55,702 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:03:55,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) spmStart polling ended, spm status: Free >2012-12-23 14:03:55,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b825a3ad-0bbe-408f-a786-343dde0f92c5), log id: 4654b545 >2012-12-23 14:03:55,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) FINISH, HSMClearTaskVDSCommand, log id: 4654b545 >2012-12-23 14:03:55,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6348e915, log id: 19d5d4dc >2012-12-23 14:03:55,744 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-50) [47be949f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:03:56,315 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [47be949f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:03:58,310 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:00,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:02,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:05,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:06,350 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:04:06,377 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:04:06,378 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5199a897 >2012-12-23 14:04:06,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) spmStart polling started: taskId = 7c011483-45d8-4982-8406-516b959b4da8 >2012-12-23 14:04:07,887 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:10,021 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:12,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:04:12,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:12,551 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) spmStart polling ended: taskId = 7c011483-45d8-4982-8406-516b959b4da8 task status = finished >2012-12-23 14:04:12,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:12,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) spmStart polling ended, spm status: Free >2012-12-23 14:04:12,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7c011483-45d8-4982-8406-516b959b4da8), log id: 23ba2a7b >2012-12-23 14:04:12,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) FINISH, HSMClearTaskVDSCommand, log id: 23ba2a7b >2012-12-23 14:04:12,594 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@44b8b285, log id: 5199a897 >2012-12-23 14:04:12,598 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-68) [39d05d02] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:04:12,673 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:12,813 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [39d05d02] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:04:14,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:17,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:19,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:21,833 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:22,844 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [754987ae] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:04:22,867 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [754987ae] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:04:22,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3d666a4b >2012-12-23 14:04:22,892 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] spmStart polling started: taskId = 9c73ad92-71b2-407e-8e88-8d898befd9a4 >2012-12-23 14:04:23,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [754987ae] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:04:23,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [754987ae] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:23,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] spmStart polling ended: taskId = 9c73ad92-71b2-407e-8e88-8d898befd9a4 task status = finished >2012-12-23 14:04:23,933 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:23,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] spmStart polling ended, spm status: Free >2012-12-23 14:04:23,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [754987ae] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9c73ad92-71b2-407e-8e88-8d898befd9a4), log id: 571b6a6b >2012-12-23 14:04:23,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [754987ae] FINISH, HSMClearTaskVDSCommand, log id: 571b6a6b >2012-12-23 14:04:23,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [754987ae] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@48e7c37a, log id: 3d666a4b >2012-12-23 14:04:23,975 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-93) [67d2a3fa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:04:24,025 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [67d2a3fa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:04:24,277 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:26,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:28,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:30,574 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:33,008 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:34,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [38a3b503] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:04:34,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [38a3b503] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:04:34,069 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 259ae3a8 >2012-12-23 14:04:34,092 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] spmStart polling started: taskId = 5332af45-da00-484e-b99a-3ad3bde6a2d8 >2012-12-23 14:04:35,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:35,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [38a3b503] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:04:35,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [38a3b503] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:35,114 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] spmStart polling ended: taskId = 5332af45-da00-484e-b99a-3ad3bde6a2d8 task status = finished >2012-12-23 14:04:35,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:35,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] spmStart polling ended, spm status: Free >2012-12-23 14:04:35,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5332af45-da00-484e-b99a-3ad3bde6a2d8), log id: 459671ae >2012-12-23 14:04:35,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] FINISH, HSMClearTaskVDSCommand, log id: 459671ae >2012-12-23 14:04:35,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [38a3b503] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@18017a33, log id: 259ae3a8 >2012-12-23 14:04:35,156 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-99) [8fdb695] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:04:35,874 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:04:37,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:04:39,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:41,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:43,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4724e456] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:45,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:45,911 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [6d74f77d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:04:45,974 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [6d74f77d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:04:46,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 757e987e >2012-12-23 14:04:46,024 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] spmStart polling started: taskId = 8c21be1c-0a21-43ae-9f66-a6c8ed47cc03 >2012-12-23 14:04:47,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [6d74f77d] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:04:47,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [6d74f77d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:47,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] spmStart polling ended: taskId = 8c21be1c-0a21-43ae-9f66-a6c8ed47cc03 task status = finished >2012-12-23 14:04:47,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:47,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] spmStart polling ended, spm status: Free >2012-12-23 14:04:47,074 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8c21be1c-0a21-43ae-9f66-a6c8ed47cc03), log id: 7c49747e >2012-12-23 14:04:47,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] FINISH, HSMClearTaskVDSCommand, log id: 7c49747e >2012-12-23 14:04:47,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [6d74f77d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3a7f3bf1, log id: 757e987e >2012-12-23 14:04:47,097 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [77386937] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:04:47,159 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:04:48,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:50,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:52,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:54,874 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [4392893e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:57,187 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:04:57,203 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:04:57,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 532c1903 >2012-12-23 14:04:57,227 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) spmStart polling started: taskId = f719278f-5db9-4fc6-9c81-57e3927a3e80 >2012-12-23 14:04:57,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:04:58,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:04:58,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:58,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) spmStart polling ended: taskId = f719278f-5db9-4fc6-9c81-57e3927a3e80 task status = finished >2012-12-23 14:04:58,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:04:58,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) spmStart polling ended, spm status: Free >2012-12-23 14:04:58,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f719278f-5db9-4fc6-9c81-57e3927a3e80), log id: 1ae9db52 >2012-12-23 14:04:58,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) FINISH, HSMClearTaskVDSCommand, log id: 1ae9db52 >2012-12-23 14:04:58,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6f3df24b, log id: 532c1903 >2012-12-23 14:04:58,296 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-40) [4bee52fb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:04:58,326 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [4bee52fb] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:04:59,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [46a6786d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts >2012-12-23 14:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering 0 hosts >2012-12-23 14:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Checking autorecoverable hosts done >2012-12-23 14:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-45) Autorecovering storage domains is disabled, skipping >2012-12-23 14:05:01,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:03,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [6abf36bb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:06,014 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:08,195 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [48dfbbd9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:08,365 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:05:08,377 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:05:08,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3207c6a8 >2012-12-23 14:05:08,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) spmStart polling started: taskId = 70f7ccb6-c801-4baa-93d5-ba4145e40e86 >2012-12-23 14:05:10,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:13,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:13,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:05:13,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:13,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) spmStart polling ended: taskId = 70f7ccb6-c801-4baa-93d5-ba4145e40e86 task status = finished >2012-12-23 14:05:13,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:13,547 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) spmStart polling ended, spm status: Free >2012-12-23 14:05:13,549 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=70f7ccb6-c801-4baa-93d5-ba4145e40e86), log id: 26a4c8d >2012-12-23 14:05:13,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) FINISH, HSMClearTaskVDSCommand, log id: 26a4c8d >2012-12-23 14:05:13,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@10c7be38, log id: 3207c6a8 >2012-12-23 14:05:13,570 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-54) [29995723] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:05:13,744 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [29995723] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:05:15,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:18,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:20,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:23,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:23,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:05:23,783 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:05:23,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 24ca5c70 >2012-12-23 14:05:23,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) spmStart polling started: taskId = a3d859d8-cbf0-404f-8356-eb3e0bcaa82d >2012-12-23 14:05:24,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:05:24,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:24,854 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) spmStart polling ended: taskId = a3d859d8-cbf0-404f-8356-eb3e0bcaa82d task status = finished >2012-12-23 14:05:24,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:24,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) spmStart polling ended, spm status: Free >2012-12-23 14:05:24,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a3d859d8-cbf0-404f-8356-eb3e0bcaa82d), log id: 6c6cc228 >2012-12-23 14:05:24,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) FINISH, HSMClearTaskVDSCommand, log id: 6c6cc228 >2012-12-23 14:05:24,915 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@583f07b4, log id: 24ca5c70 >2012-12-23 14:05:24,918 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-7) [1212e7af] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:05:25,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:26,228 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [1212e7af] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:05:28,279 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [59b8c150] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:30,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:32,940 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:35,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:36,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [67d2a3fa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:05:36,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [67d2a3fa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:05:36,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74e726f1 >2012-12-23 14:05:36,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] spmStart polling started: taskId = 75c022bb-3efd-451e-a64e-350c5a9a1c9c >2012-12-23 14:05:37,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [67d2a3fa] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:05:37,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [67d2a3fa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:37,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] spmStart polling ended: taskId = 75c022bb-3efd-451e-a64e-350c5a9a1c9c task status = finished >2012-12-23 14:05:37,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:37,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] spmStart polling ended, spm status: Free >2012-12-23 14:05:37,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=75c022bb-3efd-451e-a64e-350c5a9a1c9c), log id: 30a7e6ea >2012-12-23 14:05:37,410 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] FINISH, HSMClearTaskVDSCommand, log id: 30a7e6ea >2012-12-23 14:05:37,410 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [67d2a3fa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5f29259a, log id: 74e726f1 >2012-12-23 14:05:37,412 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-93) [663d245] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:05:37,475 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:05:37,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [190de5dd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:39,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:42,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:44,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:46,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:47,501 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:05:47,747 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) [6f89f78d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:05:47,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1493e1e0 >2012-12-23 14:05:47,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] spmStart polling started: taskId = 6e489372-1dbe-4ce8-8ef1-e236d49656ae >2012-12-23 14:05:48,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) [6f89f78d] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:05:48,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-1) [6f89f78d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:48,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] spmStart polling ended: taskId = 6e489372-1dbe-4ce8-8ef1-e236d49656ae task status = finished >2012-12-23 14:05:48,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:48,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] spmStart polling ended, spm status: Free >2012-12-23 14:05:48,819 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6e489372-1dbe-4ce8-8ef1-e236d49656ae), log id: 2b3e8e87 >2012-12-23 14:05:48,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] FINISH, HSMClearTaskVDSCommand, log id: 2b3e8e87 >2012-12-23 14:05:48,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-1) [6f89f78d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@17ff573f, log id: 1493e1e0 >2012-12-23 14:05:48,840 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-1) [7cb8f567] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:05:48,879 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:05:48,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:51,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:53,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:55,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [637c0ca0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:58,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:05:58,918 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:05:58,929 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:05:58,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4f247de4 >2012-12-23 14:05:58,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) spmStart polling started: taskId = 269ad5f8-45bd-487e-87d4-f0f09785689d >2012-12-23 14:05:59,983 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:05:59,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:05:59,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) spmStart polling ended: taskId = 269ad5f8-45bd-487e-87d4-f0f09785689d task status = finished >2012-12-23 14:05:59,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:00,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) spmStart polling ended, spm status: Free >2012-12-23 14:06:00,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-22) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=269ad5f8-45bd-487e-87d4-f0f09785689d), log id: 3e66a4ec >2012-12-23 14:06:00,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-22) FINISH, HSMClearTaskVDSCommand, log id: 3e66a4ec >2012-12-23 14:06:00,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@44d5a1f5, log id: 4f247de4 >2012-12-23 14:06:00,039 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-22) [257bff21] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:06:00,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:00,506 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [257bff21] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:06:03,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:05,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:07,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:09,940 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:10,532 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [6d3cf34c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:06:10,988 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [6d3cf34c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:06:10,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: d4e492b >2012-12-23 14:06:11,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] spmStart polling started: taskId = 634604ef-d9f8-4401-a463-3f108400578d >2012-12-23 14:06:12,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:14,216 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [4bee52fb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:15,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [6d3cf34c] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:06:15,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [6d3cf34c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:15,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] spmStart polling ended: taskId = 634604ef-d9f8-4401-a463-3f108400578d task status = finished >2012-12-23 14:06:15,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:15,125 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] spmStart polling ended, spm status: Free >2012-12-23 14:06:15,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=634604ef-d9f8-4401-a463-3f108400578d), log id: 6fd20ea0 >2012-12-23 14:06:15,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] FINISH, HSMClearTaskVDSCommand, log id: 6fd20ea0 >2012-12-23 14:06:15,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [6d3cf34c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@47be63ba, log id: d4e492b >2012-12-23 14:06:15,147 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [24856d22] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:06:15,679 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [24856d22] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:06:16,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:18,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:20,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:22,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [189365fa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:24,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [48dfbbd9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:06:25,705 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:06:25,778 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:06:25,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 917d4b3 >2012-12-23 14:06:25,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) spmStart polling started: taskId = ccd2474e-3676-4aaf-89a5-6ae209d49e88 >2012-12-23 14:06:26,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:26,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-56) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:06:26,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-56) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:26,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) spmStart polling ended: taskId = ccd2474e-3676-4aaf-89a5-6ae209d49e88 task status = finished >2012-12-23 14:06:26,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:26,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) spmStart polling ended, spm status: Free >2012-12-23 14:06:26,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-56) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ccd2474e-3676-4aaf-89a5-6ae209d49e88), log id: 5253166 >2012-12-23 14:06:26,864 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-56) FINISH, HSMClearTaskVDSCommand, log id: 5253166 >2012-12-23 14:06:26,864 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4cce222d, log id: 917d4b3 >2012-12-23 14:06:26,866 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-56) [7125dfbf] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:06:27,061 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:06:28,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:31,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:34,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:36,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:37,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [39d05d02] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:06:37,111 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [39d05d02] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:06:37,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6c5f560e >2012-12-23 14:06:37,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] spmStart polling started: taskId = 29837fec-50eb-4262-a9a7-f8e1c4bd095a >2012-12-23 14:06:38,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [39d05d02] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:06:38,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [39d05d02] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:38,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] spmStart polling ended: taskId = 29837fec-50eb-4262-a9a7-f8e1c4bd095a task status = finished >2012-12-23 14:06:38,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:38,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] spmStart polling ended, spm status: Free >2012-12-23 14:06:38,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=29837fec-50eb-4262-a9a7-f8e1c4bd095a), log id: 72853c96 >2012-12-23 14:06:38,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] FINISH, HSMClearTaskVDSCommand, log id: 72853c96 >2012-12-23 14:06:38,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [39d05d02] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@94cd697, log id: 6c5f560e >2012-12-23 14:06:38,196 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-68) [139c5846] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:06:38,241 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [139c5846] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:06:38,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:40,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:42,630 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:44,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:46,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:48,266 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:06:48,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:06:48,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 62304017 >2012-12-23 14:06:48,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) spmStart polling started: taskId = 94de8cc2-9c46-4f10-bfa4-f87f05eb6926 >2012-12-23 14:06:48,818 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:49,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:06:49,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:49,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) spmStart polling ended: taskId = 94de8cc2-9c46-4f10-bfa4-f87f05eb6926 task status = finished >2012-12-23 14:06:49,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:06:49,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) spmStart polling ended, spm status: Free >2012-12-23 14:06:49,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=94de8cc2-9c46-4f10-bfa4-f87f05eb6926), log id: 70a8df2 >2012-12-23 14:06:49,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) FINISH, HSMClearTaskVDSCommand, log id: 70a8df2 >2012-12-23 14:06:49,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@45ed0e7a, log id: 62304017 >2012-12-23 14:06:49,387 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-94) [4e518f73] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:06:49,454 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:06:50,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [190de5dd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:52,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:54,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:57,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:06:59,479 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:06:59,491 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [19cafe5e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:06:59,492 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3314476f >2012-12-23 14:06:59,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] spmStart polling started: taskId = 4f44d97b-2876-4ddf-ae85-e86f4cb6b369 >2012-12-23 14:06:59,724 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:00,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [19cafe5e] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:07:00,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [19cafe5e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:00,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] spmStart polling ended: taskId = 4f44d97b-2876-4ddf-ae85-e86f4cb6b369 task status = finished >2012-12-23 14:07:00,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:00,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] spmStart polling ended, spm status: Free >2012-12-23 14:07:00,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4f44d97b-2876-4ddf-ae85-e86f4cb6b369), log id: 69cfa8bd >2012-12-23 14:07:00,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] FINISH, HSMClearTaskVDSCommand, log id: 69cfa8bd >2012-12-23 14:07:00,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [19cafe5e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@404f4690, log id: 3314476f >2012-12-23 14:07:00,603 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-2) [14a1b8ec] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:07:00,770 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [14a1b8ec] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:07:01,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:03,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:05,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:08,035 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:10,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:10,818 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:07:11,084 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [74835e40] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:07:11,086 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 519aa996 >2012-12-23 14:07:11,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] spmStart polling started: taskId = 05711cb5-b519-4d00-becb-8b470657f6f3 >2012-12-23 14:07:13,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:15,363 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:17,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [74835e40] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:07:17,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [74835e40] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:17,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] spmStart polling ended: taskId = 05711cb5-b519-4d00-becb-8b470657f6f3 task status = finished >2012-12-23 14:07:17,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:17,274 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] spmStart polling ended, spm status: Free >2012-12-23 14:07:17,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) [74835e40] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=05711cb5-b519-4d00-becb-8b470657f6f3), log id: 1789a205 >2012-12-23 14:07:17,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) [74835e40] FINISH, HSMClearTaskVDSCommand, log id: 1789a205 >2012-12-23 14:07:17,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [74835e40] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4cec0255, log id: 519aa996 >2012-12-23 14:07:17,298 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-18) [1a8d41e7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:07:17,328 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:07:17,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:20,067 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:07:23,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:26,095 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:27,363 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:07:27,375 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:07:27,376 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5b7ac65 >2012-12-23 14:07:27,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) spmStart polling started: taskId = 51277caa-3ef2-404a-9591-efc6334eb26e >2012-12-23 14:07:28,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [24856d22] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:28,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:07:28,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:28,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) spmStart polling ended: taskId = 51277caa-3ef2-404a-9591-efc6334eb26e task status = finished >2012-12-23 14:07:28,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:28,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) spmStart polling ended, spm status: Free >2012-12-23 14:07:28,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=51277caa-3ef2-404a-9591-efc6334eb26e), log id: 48f201eb >2012-12-23 14:07:28,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) FINISH, HSMClearTaskVDSCommand, log id: 48f201eb >2012-12-23 14:07:28,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@85c10b7, log id: 5b7ac65 >2012-12-23 14:07:28,463 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-45) [544d62aa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:07:28,532 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:07:30,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [59896c29] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:32,922 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:35,020 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:37,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:38,558 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [29995723] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:07:38,571 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [29995723] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:07:38,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2fce075b >2012-12-23 14:07:38,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] spmStart polling started: taskId = 10f4551f-251c-4866-a50a-ce80fa1d31a7 >2012-12-23 14:07:39,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [29995723] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:07:39,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [29995723] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:39,639 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] spmStart polling ended: taskId = 10f4551f-251c-4866-a50a-ce80fa1d31a7 task status = finished >2012-12-23 14:07:39,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:39,659 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] spmStart polling ended, spm status: Free >2012-12-23 14:07:39,660 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [29995723] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=10f4551f-251c-4866-a50a-ce80fa1d31a7), log id: 22f8cc7a >2012-12-23 14:07:39,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [29995723] FINISH, HSMClearTaskVDSCommand, log id: 22f8cc7a >2012-12-23 14:07:39,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [29995723] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7c386f85, log id: 2fce075b >2012-12-23 14:07:39,685 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-54) [5d21c479] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:07:39,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:39,924 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [5d21c479] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:07:41,934 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:44,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:46,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:48,110 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:07:49,950 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [139c5846] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:07:49,965 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [139c5846] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:07:49,966 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 59c2dc8 >2012-12-23 14:07:49,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] spmStart polling started: taskId = 01a4b163-792e-4cf5-95d5-644fbf2f1ccb >2012-12-23 14:07:50,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:51,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [139c5846] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:07:51,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-68) [139c5846] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:51,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] spmStart polling ended: taskId = 01a4b163-792e-4cf5-95d5-644fbf2f1ccb task status = finished >2012-12-23 14:07:51,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:07:51,034 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] spmStart polling ended, spm status: Free >2012-12-23 14:07:51,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) [139c5846] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=01a4b163-792e-4cf5-95d5-644fbf2f1ccb), log id: 46171dfa >2012-12-23 14:07:51,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-68) [139c5846] FINISH, HSMClearTaskVDSCommand, log id: 46171dfa >2012-12-23 14:07:51,057 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-68) [139c5846] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@17b12c09, log id: 59c2dc8 >2012-12-23 14:07:51,059 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-68) [70c20f05] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:07:51,519 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-68) [70c20f05] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:07:52,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:54,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:56,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:07:58,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:08:01,545 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:08:01,564 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:08:01,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 43e2671f >2012-12-23 14:08:01,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) spmStart polling started: taskId = 5ab70ece-224e-4f04-8b04-df65321245ef >2012-12-23 14:08:02,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:08:02,624 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:02,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) spmStart polling ended: taskId = 5ab70ece-224e-4f04-8b04-df65321245ef task status = finished >2012-12-23 14:08:02,624 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:02,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) spmStart polling ended, spm status: Free >2012-12-23 14:08:02,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5ab70ece-224e-4f04-8b04-df65321245ef), log id: 2f108a08 >2012-12-23 14:08:02,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) FINISH, HSMClearTaskVDSCommand, log id: 2f108a08 >2012-12-23 14:08:02,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@66d62b5b, log id: 43e2671f >2012-12-23 14:08:02,664 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-26) [76b8981b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:08:02,696 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [76b8981b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:08:12,725 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [3a4b974c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:08:12,755 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [3a4b974c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:08:12,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 23f618c4 >2012-12-23 14:08:12,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] spmStart polling started: taskId = 1f262699-5829-4c00-8bdb-9c5afb139d32 >2012-12-23 14:08:18,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [3a4b974c] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:08:18,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-97) [3a4b974c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:18,932 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] spmStart polling ended: taskId = 1f262699-5829-4c00-8bdb-9c5afb139d32 task status = finished >2012-12-23 14:08:18,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:18,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] spmStart polling ended, spm status: Free >2012-12-23 14:08:18,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1f262699-5829-4c00-8bdb-9c5afb139d32), log id: 4881ccb5 >2012-12-23 14:08:18,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] FINISH, HSMClearTaskVDSCommand, log id: 4881ccb5 >2012-12-23 14:08:18,971 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-97) [3a4b974c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@41a6a443, log id: 23f618c4 >2012-12-23 14:08:18,975 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-97) [236a4c61] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:08:19,091 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:08:29,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:08:29,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:08:29,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 150943b3 >2012-12-23 14:08:29,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) spmStart polling started: taskId = 0feff74c-1e8e-4bab-868c-edd9f5a3f07e >2012-12-23 14:08:30,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:08:30,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:30,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) spmStart polling ended: taskId = 0feff74c-1e8e-4bab-868c-edd9f5a3f07e task status = finished >2012-12-23 14:08:30,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:30,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) spmStart polling ended, spm status: Free >2012-12-23 14:08:30,314 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0feff74c-1e8e-4bab-868c-edd9f5a3f07e), log id: 1ff46982 >2012-12-23 14:08:30,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) FINISH, HSMClearTaskVDSCommand, log id: 1ff46982 >2012-12-23 14:08:30,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@673ae631, log id: 150943b3 >2012-12-23 14:08:30,337 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-6) [4bdecfe9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:08:31,463 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [4bdecfe9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:08:41,498 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:08:41,547 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:08:41,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3f2f0a9e >2012-12-23 14:08:41,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) spmStart polling started: taskId = 395eccff-a3ee-4349-ad8a-7f3dbc61c654 >2012-12-23 14:08:42,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:08:42,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:42,604 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) spmStart polling ended: taskId = 395eccff-a3ee-4349-ad8a-7f3dbc61c654 task status = finished >2012-12-23 14:08:42,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:42,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) spmStart polling ended, spm status: Free >2012-12-23 14:08:42,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-29) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=395eccff-a3ee-4349-ad8a-7f3dbc61c654), log id: 1a5b6727 >2012-12-23 14:08:42,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-29) FINISH, HSMClearTaskVDSCommand, log id: 1a5b6727 >2012-12-23 14:08:42,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@66d13ef5, log id: 3f2f0a9e >2012-12-23 14:08:42,657 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-29) [337c7b8f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:08:42,875 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:08:52,922 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [4392893e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:08:53,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [4392893e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:08:53,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 15cb0932 >2012-12-23 14:08:53,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] spmStart polling started: taskId = bc686172-628e-4b09-b6b0-411b88aa4e80 >2012-12-23 14:08:54,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [4392893e] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:08:54,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [4392893e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:54,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] spmStart polling ended: taskId = bc686172-628e-4b09-b6b0-411b88aa4e80 task status = finished >2012-12-23 14:08:54,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:08:54,253 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] spmStart polling ended, spm status: Free >2012-12-23 14:08:54,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [4392893e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bc686172-628e-4b09-b6b0-411b88aa4e80), log id: 61ada5f4 >2012-12-23 14:08:54,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [4392893e] FINISH, HSMClearTaskVDSCommand, log id: 61ada5f4 >2012-12-23 14:08:54,274 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [4392893e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4f6a6845, log id: 15cb0932 >2012-12-23 14:08:54,276 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [52e3b2be] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:08:55,069 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:09:05,106 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [6abf36bb] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:09:05,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [6abf36bb] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:09:05,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 252ea240 >2012-12-23 14:09:05,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] spmStart polling started: taskId = e58a78b8-dd69-4184-bcfb-ad3837a3b682 >2012-12-23 14:09:06,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [6abf36bb] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:09:06,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [6abf36bb] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:06,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] spmStart polling ended: taskId = e58a78b8-dd69-4184-bcfb-ad3837a3b682 task status = finished >2012-12-23 14:09:06,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:06,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] spmStart polling ended, spm status: Free >2012-12-23 14:09:06,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e58a78b8-dd69-4184-bcfb-ad3837a3b682), log id: 69e2e3fa >2012-12-23 14:09:06,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] FINISH, HSMClearTaskVDSCommand, log id: 69e2e3fa >2012-12-23 14:09:06,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [6abf36bb] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2ee56865, log id: 252ea240 >2012-12-23 14:09:06,321 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-42) [5728d6f0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:09:06,363 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:09:16,389 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:09:16,432 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:09:16,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 12c4269d >2012-12-23 14:09:16,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) spmStart polling started: taskId = 7ab647e5-534c-4a55-bd5c-40e74facb833 >2012-12-23 14:09:19,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:09:19,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:19,547 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) spmStart polling ended: taskId = 7ab647e5-534c-4a55-bd5c-40e74facb833 task status = finished >2012-12-23 14:09:19,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:19,567 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) spmStart polling ended, spm status: Free >2012-12-23 14:09:19,569 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7ab647e5-534c-4a55-bd5c-40e74facb833), log id: 613a216d >2012-12-23 14:09:19,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) FINISH, HSMClearTaskVDSCommand, log id: 613a216d >2012-12-23 14:09:19,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f68acf9, log id: 12c4269d >2012-12-23 14:09:19,589 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-62) [13427c0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:09:19,625 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:09:29,651 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [77b73fe] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:09:29,677 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [77b73fe] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:09:29,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 13c8f6c2 >2012-12-23 14:09:29,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] spmStart polling started: taskId = a5cd5202-fc49-42c4-b684-c4d0b8d6471f >2012-12-23 14:09:30,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [77b73fe] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:09:30,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [77b73fe] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:30,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] spmStart polling ended: taskId = a5cd5202-fc49-42c4-b684-c4d0b8d6471f task status = finished >2012-12-23 14:09:30,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:30,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] spmStart polling ended, spm status: Free >2012-12-23 14:09:30,747 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a5cd5202-fc49-42c4-b684-c4d0b8d6471f), log id: 4bffef >2012-12-23 14:09:30,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] FINISH, HSMClearTaskVDSCommand, log id: 4bffef >2012-12-23 14:09:30,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [77b73fe] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7d8fa40f, log id: 13c8f6c2 >2012-12-23 14:09:30,768 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-72) [615c152f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:09:30,827 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [615c152f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:09:40,860 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:09:40,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:09:40,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 22fd99a3 >2012-12-23 14:09:40,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) spmStart polling started: taskId = 55683536-5599-4b2c-a636-a6a77ba1fff9 >2012-12-23 14:09:41,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:09:41,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:41,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) spmStart polling ended: taskId = 55683536-5599-4b2c-a636-a6a77ba1fff9 task status = finished >2012-12-23 14:09:41,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:42,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) spmStart polling ended, spm status: Free >2012-12-23 14:09:42,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=55683536-5599-4b2c-a636-a6a77ba1fff9), log id: 15cfbeb4 >2012-12-23 14:09:42,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) FINISH, HSMClearTaskVDSCommand, log id: 15cfbeb4 >2012-12-23 14:09:42,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@79f1269b, log id: 22fd99a3 >2012-12-23 14:09:42,032 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-82) [471dc8a8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:09:42,548 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:09:52,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [190de5dd] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:09:52,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [190de5dd] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:09:52,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 895f4a2 >2012-12-23 14:09:52,643 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] spmStart polling started: taskId = 7eb68bf6-6dd3-4cec-a6a4-190d4ae29a7c >2012-12-23 14:09:53,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [190de5dd] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:09:53,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [190de5dd] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:53,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] spmStart polling ended: taskId = 7eb68bf6-6dd3-4cec-a6a4-190d4ae29a7c task status = finished >2012-12-23 14:09:53,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:09:53,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] spmStart polling ended, spm status: Free >2012-12-23 14:09:53,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7eb68bf6-6dd3-4cec-a6a4-190d4ae29a7c), log id: 552795b0 >2012-12-23 14:09:53,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] FINISH, HSMClearTaskVDSCommand, log id: 552795b0 >2012-12-23 14:09:53,703 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [190de5dd] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@19d4817d, log id: 895f4a2 >2012-12-23 14:09:53,705 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-91) [4e8142ca] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:09:53,793 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:10:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts >2012-12-23 14:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering 0 hosts >2012-12-23 14:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Checking autorecoverable hosts done >2012-12-23 14:10:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-98) Autorecovering storage domains is disabled, skipping >2012-12-23 14:10:03,820 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:10:04,068 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:10:04,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 330195fe >2012-12-23 14:10:04,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) spmStart polling started: taskId = 45fa4b96-a11e-4f74-92dd-dbede4abb7b1 >2012-12-23 14:10:05,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:10:05,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:05,115 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) spmStart polling ended: taskId = 45fa4b96-a11e-4f74-92dd-dbede4abb7b1 task status = finished >2012-12-23 14:10:05,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:05,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) spmStart polling ended, spm status: Free >2012-12-23 14:10:05,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-100) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=45fa4b96-a11e-4f74-92dd-dbede4abb7b1), log id: 4dee7478 >2012-12-23 14:10:05,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-100) FINISH, HSMClearTaskVDSCommand, log id: 4dee7478 >2012-12-23 14:10:05,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@62209a40, log id: 330195fe >2012-12-23 14:10:05,160 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-100) [4a6f1214] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:10:05,610 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:10:15,637 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4724e456] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:10:15,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4724e456] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:10:15,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 790e2243 >2012-12-23 14:10:15,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] spmStart polling started: taskId = 12984c86-fe8b-4cfe-9d29-7b9c212c34e3 >2012-12-23 14:10:21,896 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [4724e456] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:10:21,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [4724e456] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:21,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] spmStart polling ended: taskId = 12984c86-fe8b-4cfe-9d29-7b9c212c34e3 task status = finished >2012-12-23 14:10:21,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:21,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] spmStart polling ended, spm status: Free >2012-12-23 14:10:21,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [4724e456] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=12984c86-fe8b-4cfe-9d29-7b9c212c34e3), log id: 66196afa >2012-12-23 14:10:21,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [4724e456] FINISH, HSMClearTaskVDSCommand, log id: 66196afa >2012-12-23 14:10:21,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4724e456] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@ebe7774, log id: 790e2243 >2012-12-23 14:10:21,941 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [7a94683b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:10:21,984 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:10:32,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:10:32,095 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:10:32,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 19f3b52d >2012-12-23 14:10:32,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) spmStart polling started: taskId = a7a4cb04-164f-4d8a-a43c-ec3730053794 >2012-12-23 14:10:33,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:10:33,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:33,146 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) spmStart polling ended: taskId = a7a4cb04-164f-4d8a-a43c-ec3730053794 task status = finished >2012-12-23 14:10:33,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:33,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) spmStart polling ended, spm status: Free >2012-12-23 14:10:33,166 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a7a4cb04-164f-4d8a-a43c-ec3730053794), log id: 516dc3b5 >2012-12-23 14:10:33,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) FINISH, HSMClearTaskVDSCommand, log id: 516dc3b5 >2012-12-23 14:10:33,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7d4bc9d6, log id: 19f3b52d >2012-12-23 14:10:33,187 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-31) [7ab040dd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:10:33,226 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:10:43,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [4bee52fb] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:10:43,289 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [4bee52fb] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:10:43,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7769fba0 >2012-12-23 14:10:43,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] spmStart polling started: taskId = 8f22641e-7d01-4a98-b56e-13d35f0342d3 >2012-12-23 14:10:44,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [4bee52fb] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:10:44,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [4bee52fb] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:44,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] spmStart polling ended: taskId = 8f22641e-7d01-4a98-b56e-13d35f0342d3 task status = finished >2012-12-23 14:10:44,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:44,356 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] spmStart polling ended, spm status: Free >2012-12-23 14:10:44,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8f22641e-7d01-4a98-b56e-13d35f0342d3), log id: 725224dd >2012-12-23 14:10:44,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] FINISH, HSMClearTaskVDSCommand, log id: 725224dd >2012-12-23 14:10:44,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [4bee52fb] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6ef263cd, log id: 7769fba0 >2012-12-23 14:10:44,379 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-40) [6b7660a2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:10:44,421 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:10:54,449 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:10:54,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [2bc8956e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:10:54,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4d1b6e6b >2012-12-23 14:10:54,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] spmStart polling started: taskId = 8df56228-16d4-496e-bfb8-92cb71d200c1 >2012-12-23 14:10:55,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [2bc8956e] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:10:55,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [2bc8956e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:55,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] spmStart polling ended: taskId = 8df56228-16d4-496e-bfb8-92cb71d200c1 task status = finished >2012-12-23 14:10:55,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:10:55,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] spmStart polling ended, spm status: Free >2012-12-23 14:10:55,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8df56228-16d4-496e-bfb8-92cb71d200c1), log id: 625d0d59 >2012-12-23 14:10:55,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] FINISH, HSMClearTaskVDSCommand, log id: 625d0d59 >2012-12-23 14:10:55,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [2bc8956e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4b178082, log id: 4d1b6e6b >2012-12-23 14:10:55,637 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-49) [73f5fd51] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:10:55,852 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [73f5fd51] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:00,810 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 14:11:02,890 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:04,936 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:05,879 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:11:05,898 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:11:05,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 69260c77 >2012-12-23 14:11:05,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) spmStart polling started: taskId = e5998729-dd07-4436-938b-c27753d08f9d >2012-12-23 14:11:06,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:11:06,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-64) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:06,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) spmStart polling ended: taskId = e5998729-dd07-4436-938b-c27753d08f9d task status = finished >2012-12-23 14:11:06,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:06,966 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) spmStart polling ended, spm status: Free >2012-12-23 14:11:06,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-64) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e5998729-dd07-4436-938b-c27753d08f9d), log id: 35fc9fef >2012-12-23 14:11:06,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:06,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-64) FINISH, HSMClearTaskVDSCommand, log id: 35fc9fef >2012-12-23 14:11:06,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-64) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f331ae9, log id: 69260c77 >2012-12-23 14:11:06,994 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-64) [542bc6ff] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:11:07,042 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:09,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:11,105 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:13,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:15,642 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [70c20f05] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:17,069 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [59b8c150] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:11:17,115 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [59b8c150] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:11:17,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2af4840d >2012-12-23 14:11:17,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] spmStart polling started: taskId = 1241b9c9-83df-498f-a7aa-9deb62ba3d84 >2012-12-23 14:11:17,963 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:20,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:22,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:23,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [59b8c150] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:11:23,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [59b8c150] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:23,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] spmStart polling ended: taskId = 1241b9c9-83df-498f-a7aa-9deb62ba3d84 task status = finished >2012-12-23 14:11:23,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:23,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] spmStart polling ended, spm status: Free >2012-12-23 14:11:23,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1241b9c9-83df-498f-a7aa-9deb62ba3d84), log id: 28ca4df5 >2012-12-23 14:11:23,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] FINISH, HSMClearTaskVDSCommand, log id: 28ca4df5 >2012-12-23 14:11:23,332 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [59b8c150] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@79c424be, log id: 2af4840d >2012-12-23 14:11:23,335 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [3c487466] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:11:23,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:24,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:26,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:28,219 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:30,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:32,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:33,453 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:11:33,464 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:11:33,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4761099d >2012-12-23 14:11:33,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) spmStart polling started: taskId = 38b2fa37-8190-4900-85a9-56c2f938e1b7 >2012-12-23 14:11:34,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:11:34,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:34,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) spmStart polling ended: taskId = 38b2fa37-8190-4900-85a9-56c2f938e1b7 task status = finished >2012-12-23 14:11:34,512 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:34,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) spmStart polling ended, spm status: Free >2012-12-23 14:11:34,532 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=38b2fa37-8190-4900-85a9-56c2f938e1b7), log id: 17178eab >2012-12-23 14:11:34,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) FINISH, HSMClearTaskVDSCommand, log id: 17178eab >2012-12-23 14:11:34,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@b978865, log id: 4761099d >2012-12-23 14:11:34,554 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-98) [97ba4d5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:11:34,599 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:35,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:37,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:39,098 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:41,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:43,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:44,627 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:11:44,686 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:11:44,688 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 27947f3d >2012-12-23 14:11:44,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) spmStart polling started: taskId = 984aae94-7bcb-42e8-bc81-f59e8d6c253f >2012-12-23 14:11:45,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:45,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:11:45,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:45,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) spmStart polling ended: taskId = 984aae94-7bcb-42e8-bc81-f59e8d6c253f task status = finished >2012-12-23 14:11:45,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:45,757 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) spmStart polling ended, spm status: Free >2012-12-23 14:11:45,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=984aae94-7bcb-42e8-bc81-f59e8d6c253f), log id: 38afaa77 >2012-12-23 14:11:45,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) FINISH, HSMClearTaskVDSCommand, log id: 38afaa77 >2012-12-23 14:11:45,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@14e087b4, log id: 27947f3d >2012-12-23 14:11:45,780 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [20ed4521] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:11:45,864 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:47,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:49,831 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:51,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [6a21b0aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:54,014 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:55,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:11:56,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [7a0a6226] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:11:56,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5a3bb8f7 >2012-12-23 14:11:56,038 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] spmStart polling started: taskId = 0b9ec32d-75cc-4e33-b87c-948564ba7335 >2012-12-23 14:11:56,092 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:11:57,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [7a0a6226] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:11:57,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [7a0a6226] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:57,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] spmStart polling ended: taskId = 0b9ec32d-75cc-4e33-b87c-948564ba7335 task status = finished >2012-12-23 14:11:57,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:11:57,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] spmStart polling ended, spm status: Free >2012-12-23 14:11:57,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0b9ec32d-75cc-4e33-b87c-948564ba7335), log id: 37a2640e >2012-12-23 14:11:57,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] FINISH, HSMClearTaskVDSCommand, log id: 37a2640e >2012-12-23 14:11:57,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [7a0a6226] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@656efab, log id: 5a3bb8f7 >2012-12-23 14:11:57,104 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [3590c6cd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:11:57,182 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3590c6cd] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:11:58,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:08,209 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [24856d22] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:12:08,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [24856d22] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:12:08,222 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 54e1328 >2012-12-23 14:12:08,245 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] spmStart polling started: taskId = cb71f7e2-3256-44a7-b1c5-d20c15bc3bc1 >2012-12-23 14:12:10,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [24856d22] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:12:10,268 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [24856d22] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:10,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] spmStart polling ended: taskId = cb71f7e2-3256-44a7-b1c5-d20c15bc3bc1 task status = finished >2012-12-23 14:12:10,268 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:10,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] spmStart polling ended, spm status: Free >2012-12-23 14:12:10,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [24856d22] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=cb71f7e2-3256-44a7-b1c5-d20c15bc3bc1), log id: 43c15b8f >2012-12-23 14:12:10,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [24856d22] FINISH, HSMClearTaskVDSCommand, log id: 43c15b8f >2012-12-23 14:12:10,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [24856d22] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4b622c09, log id: 54e1328 >2012-12-23 14:12:10,315 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [1a392989] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:12:10,685 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [1a392989] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:12:20,764 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [189365fa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:12:20,773 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [189365fa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:12:20,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1c44fcca >2012-12-23 14:12:20,799 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] spmStart polling started: taskId = 8ca19c21-d217-4d27-b5d0-28b0aa66a82e >2012-12-23 14:12:23,878 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [189365fa] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:12:23,878 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [189365fa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:23,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] spmStart polling ended: taskId = 8ca19c21-d217-4d27-b5d0-28b0aa66a82e task status = finished >2012-12-23 14:12:23,878 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:23,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] spmStart polling ended, spm status: Free >2012-12-23 14:12:23,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [189365fa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8ca19c21-d217-4d27-b5d0-28b0aa66a82e), log id: 139b27f6 >2012-12-23 14:12:23,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [189365fa] FINISH, HSMClearTaskVDSCommand, log id: 139b27f6 >2012-12-23 14:12:23,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [189365fa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f5c9188, log id: 1c44fcca >2012-12-23 14:12:23,920 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-47) [66569002] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:12:23,956 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [66569002] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:12:31,214 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:33,277 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:33,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:12:34,025 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [6262591d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:12:34,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 202cbbb6 >2012-12-23 14:12:34,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] spmStart polling started: taskId = 8dd55f07-2ea5-4578-bd8f-060f45ec01d1 >2012-12-23 14:12:35,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [6262591d] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:12:35,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-63) [6262591d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:35,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] spmStart polling ended: taskId = 8dd55f07-2ea5-4578-bd8f-060f45ec01d1 task status = finished >2012-12-23 14:12:35,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:35,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] spmStart polling ended, spm status: Free >2012-12-23 14:12:35,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-63) [6262591d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8dd55f07-2ea5-4578-bd8f-060f45ec01d1), log id: 4ee759a7 >2012-12-23 14:12:35,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-63) [6262591d] FINISH, HSMClearTaskVDSCommand, log id: 4ee759a7 >2012-12-23 14:12:35,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-63) [6262591d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@36af0b69, log id: 202cbbb6 >2012-12-23 14:12:35,121 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-63) [1e16368b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:12:35,259 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:12:35,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:37,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [615c152f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:39,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:41,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:12:44,994 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-68) [5b660154] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:12:45,171 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: d210761 >2012-12-23 14:12:45,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: d210761 >2012-12-23 14:12:45,201 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-68) [5a8ffe11] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:12:45,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7d48adb3 >2012-12-23 14:12:45,228 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 7d48adb3 >2012-12-23 14:12:45,229 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-68) [5a8ffe11] Host orchid-vds1 storage connection was succeeded >2012-12-23 14:12:45,286 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:12:45,782 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 63ebd86e >2012-12-23 14:12:45,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-68) [5a8ffe11] FINISH, ConnectStoragePoolVDSCommand, log id: 63ebd86e >2012-12-23 14:12:45,846 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-68) [5a8ffe11] No string for UNASSIGNED type. Use default Log >2012-12-23 14:12:45,855 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [5a8ffe11] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:12:46,067 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:12:46,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 149f6288 >2012-12-23 14:12:46,248 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) spmStart polling started: taskId = 98b694b9-1ef1-41d7-b8e2-267c1edd214d >2012-12-23 14:12:46,286 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-68) [5a8ffe11] Initializing Host: orchid-vds1 >2012-12-23 14:12:46,295 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-68) [6bfdd94b] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:12:46,341 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-68) [128b3ba1] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:12:47,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:12:47,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:47,273 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) spmStart polling ended: taskId = 98b694b9-1ef1-41d7-b8e2-267c1edd214d task status = finished >2012-12-23 14:12:47,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:12:47,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) spmStart polling ended, spm status: Free >2012-12-23 14:12:47,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-78) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=98b694b9-1ef1-41d7-b8e2-267c1edd214d), log id: 2190006f >2012-12-23 14:12:47,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-78) FINISH, HSMClearTaskVDSCommand, log id: 2190006f >2012-12-23 14:12:47,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@750c889f, log id: 149f6288 >2012-12-23 14:12:47,318 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-78) [9ddbac2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:12:47,382 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [9ddbac2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:12:47,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [9ddbac2] Irs placed on server null failed. Proceed Failover >2012-12-23 14:12:47,443 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [9ddbac2] hostFromVds::selectedVds - orchid-vds1, spmStatus SPM, storage pool DC31-CLI >2012-12-23 14:12:47,466 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [9ddbac2] Initialize Irs proxy from vds: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:12:47,541 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-13) START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 4a399ae6 >2012-12-23 14:12:47,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-13) -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 14:12:47,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-13) START, HSMGetAllTasksInfoVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: d0024bf >2012-12-23 14:12:47,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-13) FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: d0024bf >2012-12-23 14:12:47,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-13) FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 4a399ae6 >2012-12-23 14:12:47,743 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-13) Discovered no tasks on Storage Pool DC31-CLI >2012-12-23 14:14:33,056 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [2a328963] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:14:33,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2a328963] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=b66af557-e23f-4637-941f-e400687ccf9a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=b66af557-e23f-4637-941f-e400687ccf9a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x09, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 87a3350 >2012-12-23 14:14:33,665 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2a328963] FINISH, HotUnplugNicVDSCommand, log id: 87a3350 >2012-12-23 14:14:39,655 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-50) [6513c67] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:14:39,661 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [6513c67] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 14:14:47,862 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-8) [61bb4ab2] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:14:47,865 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-8) [61bb4ab2] MacPoolManager::allocateNewMac entered >2012-12-23 14:14:47,866 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-8) [61bb4ab2] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:59 >2012-12-23 14:14:48,168 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-8) [16678dc5] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:14:48,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-8) [16678dc5] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=77594c98-74d6-4069-beea-6861b2031981, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=77594c98-74d6-4069-beea-6861b2031981, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 40a95680 >2012-12-23 14:14:48,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-8) [16678dc5] FINISH, HotPlugNicVDSCommand, log id: 40a95680 >2012-12-23 14:14:57,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-66) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 5abd4f14 >2012-12-23 14:14:57,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-66) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4292d896, log id: 5abd4f14 >2012-12-23 14:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7234eda1] Checking autorecoverable hosts >2012-12-23 14:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7234eda1] Autorecovering 0 hosts >2012-12-23 14:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7234eda1] Checking autorecoverable hosts done >2012-12-23 14:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-73) [7234eda1] Autorecovering storage domains is disabled, skipping >2012-12-23 14:16:12,637 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-10) [57b39207] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:16:12,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [57b39207] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=77594c98-74d6-4069-beea-6861b2031981, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=77594c98-74d6-4069-beea-6861b2031981, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0a, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 58e82499 >2012-12-23 14:16:12,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [57b39207] FINISH, HotUnplugNicVDSCommand, log id: 58e82499 >2012-12-23 14:16:18,261 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-10) [35751a56] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:16:18,267 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-10) [35751a56] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:59) - entered >2012-12-23 14:16:35,651 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-4) [58f39d36] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:16:35,794 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-4) [3f685ba4] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:16:35,796 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-4) [3f685ba4] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=98516027-26b0-47b0-9ac9-a6e0191a1091, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=98516027-26b0-47b0-9ac9-a6e0191a1091, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 4a986c06 >2012-12-23 14:16:36,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-4) [3f685ba4] FINISH, HotPlugNicVDSCommand, log id: 4a986c06 >2012-12-23 14:16:42,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-99) [8fdb695] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 5fba83ca >2012-12-23 14:16:42,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-99) [8fdb695] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@37e55d8c, log id: 5fba83ca >2012-12-23 14:17:01,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [50628120] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:01,686 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-27) [65ebe64b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:17:02,226 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [65ebe64b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2012-12-23 14:17:02,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [65ebe64b] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:02,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [65ebe64b] Irs placed on server null failed. Proceed Failover >2012-12-23 14:17:02,256 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [65ebe64b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:17:02,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [65ebe64b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:17:02,368 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 24dcf152 >2012-12-23 14:17:02,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] spmStart polling started: taskId = 089677ec-d907-4271-9bd3-8cd4e1de0ac2 >2012-12-23 14:17:02,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] XML RPC error in command ListVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:02,475 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-31) [7ab040dd] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:03,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [65ebe64b] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:17:03,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [65ebe64b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:17:03,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] spmStart polling ended: taskId = 089677ec-d907-4271-9bd3-8cd4e1de0ac2 task status = finished >2012-12-23 14:17:03,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:17:03,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] spmStart polling ended, spm status: Free >2012-12-23 14:17:03,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=089677ec-d907-4271-9bd3-8cd4e1de0ac2), log id: 7425a37 >2012-12-23 14:17:03,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] FINISH, HSMClearTaskVDSCommand, log id: 7425a37 >2012-12-23 14:17:03,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [65ebe64b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1530d49a, log id: 24dcf152 >2012-12-23 14:17:03,455 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-27) [38d5d554] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:17:03,541 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:17:04,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [3590c6cd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:04,516 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-32) [3590c6cd] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:06,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:06,528 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-44) [5a8fa6d6] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:16,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [1a392989] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:17:16,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [1a392989] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:17:16,255 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [1a392989] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1f5cdd49 >2012-12-23 14:17:16,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [1a392989] spmStart polling started: taskId = c3ae590f-5252-4d1f-b4bd-488fc4c4c09f >2012-12-23 14:17:39,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:39,542 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-43) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:41,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:41,554 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-63) [1e16368b] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:43,581 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:43,581 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-64) [542bc6ff] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:45,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [615c152f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:45,599 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-72) [615c152f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:47,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:47,611 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-77) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:49,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1212e7af] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:49,623 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-7) [1212e7af] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:17:52,052 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:17:52,052 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-76) [52db807f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [76b8981b] Checking autorecoverable hosts >2012-12-23 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [76b8981b] Autorecovering 0 hosts >2012-12-23 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [76b8981b] Checking autorecoverable hosts done >2012-12-23 14:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-26) [76b8981b] Autorecovering storage domains is disabled, skipping >2012-12-23 14:20:17,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [1a392989] XML RPC error in command HSMGetTaskStatusVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 14:20:17,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [1a392989] Command org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.irsbroker.OneUuidReturnForXmlRpc >mUuid c3ae590f-5252-4d1f-b4bd-488fc4c4c09f >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 0 >mMessage OK > > >2012-12-23 14:20:17,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [1a392989] HostName = orchid-vds2 >2012-12-23 14:20:17,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [1a392989] Failed in SpmStartVDS method, for vds: orchid-vds2; host: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:20:17,285 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-38) [1a392989] Command SpmStartVDS execution failed. Exception: NullPointerException: >2012-12-23 14:20:17,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [1a392989] FINISH, SpmStartVDSCommand, log id: 1f5cdd49 >2012-12-23 14:20:17,288 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [368d7d04] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:20:17,318 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [368d7d04] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:20:27,357 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [4bdecfe9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:20:27,368 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [4bdecfe9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:20:27,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6cc2fc0e >2012-12-23 14:20:27,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] spmStart polling started: taskId = 8f85ef81-ea5a-4f22-821e-d971f22ab26d >2012-12-23 14:20:28,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [4bdecfe9] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:20:28,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [4bdecfe9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:28,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] spmStart polling ended: taskId = 8f85ef81-ea5a-4f22-821e-d971f22ab26d task status = finished >2012-12-23 14:20:28,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:28,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] spmStart polling ended, spm status: Free >2012-12-23 14:20:28,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8f85ef81-ea5a-4f22-821e-d971f22ab26d), log id: 5711357 >2012-12-23 14:20:28,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] FINISH, HSMClearTaskVDSCommand, log id: 5711357 >2012-12-23 14:20:28,455 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [4bdecfe9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@42acb78b, log id: 6cc2fc0e >2012-12-23 14:20:28,461 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-6) [594628df] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:20:28,509 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:20:38,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:20:38,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [77386937] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:20:38,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 27b81efe >2012-12-23 14:20:38,582 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] spmStart polling started: taskId = 96131b85-41a4-490a-a942-2f84de6f000b >2012-12-23 14:20:39,618 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [77386937] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:20:39,619 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [77386937] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:39,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] spmStart polling ended: taskId = 96131b85-41a4-490a-a942-2f84de6f000b task status = finished >2012-12-23 14:20:39,619 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:39,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] spmStart polling ended, spm status: Free >2012-12-23 14:20:39,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [77386937] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=96131b85-41a4-490a-a942-2f84de6f000b), log id: 3a262a1a >2012-12-23 14:20:39,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [77386937] FINISH, HSMClearTaskVDSCommand, log id: 3a262a1a >2012-12-23 14:20:39,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [77386937] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f962ec9, log id: 27b81efe >2012-12-23 14:20:39,674 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [3cd99e52] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:20:39,734 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3cd99e52] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:20:49,765 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3590c6cd] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:20:49,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3590c6cd] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:20:49,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 64507dbc >2012-12-23 14:20:49,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] spmStart polling started: taskId = c3a0d530-277f-47be-8498-61f45aa7e576 >2012-12-23 14:20:50,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [3590c6cd] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:20:50,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [3590c6cd] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:50,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] spmStart polling ended: taskId = c3a0d530-277f-47be-8498-61f45aa7e576 task status = finished >2012-12-23 14:20:50,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:20:50,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] spmStart polling ended, spm status: Free >2012-12-23 14:20:50,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c3a0d530-277f-47be-8498-61f45aa7e576), log id: 7a92f565 >2012-12-23 14:20:50,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] FINISH, HSMClearTaskVDSCommand, log id: 7a92f565 >2012-12-23 14:20:50,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3590c6cd] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@462cf8c1, log id: 64507dbc >2012-12-23 14:20:50,894 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [327f6ae5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:20:50,960 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:20:54,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 14:20:54,058 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-83) VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 14:20:54,092 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-49) ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:20:54,199 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-49) [7fa4765f] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 14:20:57,685 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-48) [12d5062e] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:20:57,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-48) [744820a7] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 331c88c >2012-12-23 14:20:57,838 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-48) [744820a7] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 331c88c >2012-12-23 14:20:57,838 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-48) [744820a7] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:20:57,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-48) [744820a7] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7de3d242 >2012-12-23 14:20:57,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-48) [744820a7] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 7de3d242 >2012-12-23 14:20:57,865 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-48) [744820a7] Host orchid-vds1 storage connection was succeeded >2012-12-23 14:20:57,886 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-48) [744820a7] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 6a884962 >2012-12-23 14:20:57,908 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-48) [744820a7] FINISH, ConnectStoragePoolVDSCommand, log id: 6a884962 >2012-12-23 14:20:57,943 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-48) [744820a7] No string for UNASSIGNED type. Use default Log >2012-12-23 14:20:57,945 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [744820a7] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:20:57,964 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-48) [7e96cdcb] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:20:57,993 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-48) [896989f] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:21:00,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [73f5fd51] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:21:01,006 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [73f5fd51] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:21:01,008 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4276b3aa >2012-12-23 14:21:01,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] spmStart polling started: taskId = ad495058-ee36-4557-97bb-df7cba6af297 >2012-12-23 14:21:02,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [73f5fd51] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:21:02,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-49) [73f5fd51] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:21:02,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] spmStart polling ended: taskId = ad495058-ee36-4557-97bb-df7cba6af297 task status = finished >2012-12-23 14:21:02,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:21:02,084 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] spmStart polling ended, spm status: Free >2012-12-23 14:21:02,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ad495058-ee36-4557-97bb-df7cba6af297), log id: 10f9332 >2012-12-23 14:21:02,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] FINISH, HSMClearTaskVDSCommand, log id: 10f9332 >2012-12-23 14:21:02,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-49) [73f5fd51] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2588b829, log id: 4276b3aa >2012-12-23 14:21:02,108 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-49) [32f29eff] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:21:02,340 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:21:02,360 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] Irs placed on server null failed. Proceed Failover >2012-12-23 14:21:02,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] hostFromVds::selectedVds - orchid-vds1, spmStatus SPM, storage pool DC31-CLI >2012-12-23 14:21:02,404 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] Initialize Irs proxy from vds: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:21:02,529 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-47) [66569002] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 6a2f99d8 >2012-12-23 14:21:02,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-47) [66569002] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 14:21:02,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-47) [66569002] START, HSMGetAllTasksInfoVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: 28ad73ea >2012-12-23 14:21:02,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-47) [66569002] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 28ad73ea >2012-12-23 14:21:02,647 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-47) [66569002] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 6a2f99d8 >2012-12-23 14:21:02,647 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-47) [66569002] Discovered no tasks on Storage Pool DC31-CLI >2012-12-23 14:25:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts >2012-12-23 14:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering 0 hosts >2012-12-23 14:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Checking autorecoverable hosts done >2012-12-23 14:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-88) Autorecovering storage domains is disabled, skipping >2012-12-23 14:26:30,216 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1212e7af] XML RPC error in command ListVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:26:30,229 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-7) [1212e7af] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:32,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:26:32,236 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-91) [4e8142ca] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:34,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:26:34,242 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) [4e518f73] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:36,249 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:26:36,249 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-90) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:38,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:26:38,256 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-92) [4cede70f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:59,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] XML RPC error in command ListVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:26:59,247 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [9ddbac2] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:26:59,250 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-78) [2260099b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:26:59,260 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-75) [3c487466] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:26:59,289 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:01,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:01,268 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-99) [8fdb695] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:27:03,275 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:03,275 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-5) [21718bb8] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:27:05,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:05,281 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-17) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:27:07,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:07,288 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-12) [30830827] VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 14:27:07,369 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-50) [30830827] ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:27:07,442 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-50) [305aa7d4] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 14:27:36,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:27:36,287 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-95) [fbf7edf] VDS::handleNetworkException Server failed to respond, vds_id = 2d10c76a-49a9-11e2-9ecf-001122334455, vds_name = orchid-vds2, error = VDSNetworkException: >2012-12-23 14:27:36,329 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-47) [fbf7edf] ResourceManager::vdsNotResponding entered for Host 2d10c76a-49a9-11e2-9ecf-001122334455, orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:27:36,488 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-47) [67c1b6c4] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 14:27:38,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:27:40,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [6a21b0aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:27:42,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:27:44,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:28:05,314 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:05,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:05,321 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:07,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:09,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:11,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:14,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:28:42,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:28:44,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:28:46,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:28:48,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:28:50,893 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:29:11,385 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [66569002] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:11,386 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [47be949f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:11,389 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [66569002] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:13,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:15,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:17,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:19,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:29:48,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:29:51,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:29:53,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:29:55,161 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [14a1b8ec] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:29:57,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [368d7d04] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [3c487466] Checking autorecoverable hosts >2012-12-23 14:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [3c487466] Autorecovering 0 hosts >2012-12-23 14:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [3c487466] Checking autorecoverable hosts done >2012-12-23 14:30:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-75) [3c487466] Autorecovering storage domains is disabled, skipping >2012-12-23 14:30:17,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:17,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:17,418 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:19,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:21,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:23,579 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [637c0ca0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:25,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:30:55,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:30:57,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:30:59,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:31:02,018 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:31:04,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:31:23,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:23,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:23,448 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:25,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:27,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:29,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:31:31,625 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:02,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:32:04,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:32:06,845 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:32:09,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:32:11,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:32:29,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:29,497 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [48dfbbd9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:29,502 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:31,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:33,600 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-26) [76b8981b] DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 14:32:33,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:36,087 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:32:38,152 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:09,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:33:11,219 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:33:13,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:33:15,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:33:17,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:33:35,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:35,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:35,530 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:37,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3cd99e52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:39,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:41,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:33:44,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:15,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:34:17,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:34:19,626 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:34:21,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:34:24,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:34:41,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:41,556 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:41,560 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:43,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [5d21c479] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:46,035 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:48,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:34:50,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [615c152f] Checking autorecoverable hosts >2012-12-23 14:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [615c152f] Autorecovering 0 hosts >2012-12-23 14:35:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [615c152f] Checking autorecoverable hosts done >2012-12-23 14:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-72) [615c152f] Autorecovering storage domains is disabled, skipping >2012-12-23 14:35:22,200 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:35:24,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:35:26,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:35:28,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [48dfbbd9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:35:30,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:35:47,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:47,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:47,600 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:49,645 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:51,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:54,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:35:56,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:28,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:36:30,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:36:32,544 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:36:34,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:36:36,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:36:53,626 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:53,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:53,631 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:55,659 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:57,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:36:59,814 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:37:01,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:37:46,929 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:37:49,081 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [5d21c479] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:37:51,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:37:53,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:37:55,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:37:59,682 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:37:59,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:37:59,690 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:38:01,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:38:03,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:38:05,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [615c152f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:38:07,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:38:53,261 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:38:55,318 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:38:57,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:38:59,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:39:01,752 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:39:05,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:05,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:05,726 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:07,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:10,084 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [14a1b8ec] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:12,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [368d7d04] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:39:14,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [337c7b8f] Checking autorecoverable hosts >2012-12-23 14:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [337c7b8f] Autorecovering 0 hosts >2012-12-23 14:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [337c7b8f] Checking autorecoverable hosts done >2012-12-23 14:40:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-29) [337c7b8f] Autorecovering storage domains is disabled, skipping >2012-12-23 14:40:00,064 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:40:02,109 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:40:04,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:40:06,579 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:40:09,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:40:11,756 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:11,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:11,761 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:14,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:16,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:18,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:40:20,332 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [46a6786d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:07,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:41:09,796 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:41:11,827 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:41:14,237 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:41:16,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 14:41:17,780 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [896989f] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:17,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:17,785 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [896989f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:19,676 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-72) [72feef94] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:41:19,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:20,240 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-72) [45b8b762] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:41:20,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-72) [45b8b762] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 159bca6d >2012-12-23 14:41:20,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-72) [45b8b762] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 159bca6d >2012-12-23 14:41:20,268 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-72) [45b8b762] Host orchid-vds2 storage connection was succeeded >2012-12-23 14:41:20,290 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-72) [45b8b762] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 7ffc4392 >2012-12-23 14:41:20,313 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-72) [45b8b762] FINISH, ConnectStoragePoolVDSCommand, log id: 7ffc4392 >2012-12-23 14:41:20,360 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-72) [45b8b762] No string for UNASSIGNED type. Use default Log >2012-12-23 14:41:20,363 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [45b8b762] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:41:20,406 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-72) [5b9e4617] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 14:41:20,480 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-72) [198dadd] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 14:41:22,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:24,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [47be949f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:26,438 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, UnknownHostException: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:41:29,043 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-53) [3fadd93a] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:41:29,112 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-53) [659d37db] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1a03afc0 >2012-12-23 14:41:29,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-53) [659d37db] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 1a03afc0 >2012-12-23 14:41:29,135 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-53) [659d37db] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:41:29,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-53) [659d37db] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 2eed8134 >2012-12-23 14:41:29,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-53) [659d37db] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 2eed8134 >2012-12-23 14:41:29,163 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-53) [659d37db] Host orchid-vds1 storage connection was succeeded >2012-12-23 14:41:29,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-53) [659d37db] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 6d93e7ff >2012-12-23 14:41:29,218 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-53) [659d37db] FINISH, ConnectStoragePoolVDSCommand, log id: 6d93e7ff >2012-12-23 14:41:29,259 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-53) [659d37db] No string for UNASSIGNED type. Use default Log >2012-12-23 14:41:29,273 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) [659d37db] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:41:29,288 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-53) [35e45160] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:41:29,340 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-53) [3c2192c2] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:44:00,190 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [3bf62a2c] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:44:00,193 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [3bf62a2c] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=98516027-26b0-47b0-9ac9-a6e0191a1091, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=98516027-26b0-47b0-9ac9-a6e0191a1091, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0b, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 8301c0a >2012-12-23 14:44:00,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [3bf62a2c] FINISH, HotUnplugNicVDSCommand, log id: 8301c0a >2012-12-23 14:44:05,793 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-50) [7279e23] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:44:05,795 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [7279e23] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 14:44:23,613 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-11) [19ef0514] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:44:23,760 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-11) [449e6fb4] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:44:23,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [449e6fb4] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=2eb266bd-712f-4f0d-8191-bd970c7f32ba, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:16:17:18:19:20, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=2eb266bd-712f-4f0d-8191-bd970c7f32ba, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 303e9521 >2012-12-23 14:44:24,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [449e6fb4] FINISH, HotPlugNicVDSCommand, log id: 303e9521 >2012-12-23 14:44:24,892 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) [7ab040dd] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 617ce783 >2012-12-23 14:44:24,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) [7ab040dd] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4f437b75, log id: 617ce783 >2012-12-23 14:45:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [128b3ba1] Checking autorecoverable hosts >2012-12-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [128b3ba1] Autorecovering 0 hosts >2012-12-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [128b3ba1] Checking autorecoverable hosts done >2012-12-23 14:45:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-68) [128b3ba1] Autorecovering storage domains is disabled, skipping >2012-12-23 14:46:00,824 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [58f16803] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:46:00,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [58f16803] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=2eb266bd-712f-4f0d-8191-bd970c7f32ba, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:16:17:18:19:20, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=2eb266bd-712f-4f0d-8191-bd970c7f32ba, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0c, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 524192c0 >2012-12-23 14:46:01,090 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [58f16803] FINISH, HotUnplugNicVDSCommand, log id: 524192c0 >2012-12-23 14:46:05,415 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-47) [76aad4ce] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:46:05,421 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) [76aad4ce] MacPoolManager::freeMac(mac = 00:16:17:18:19:20) - entered >2012-12-23 14:46:27,632 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [7ec52b25] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:46:27,738 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [4d0dafd3] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:46:27,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [4d0dafd3] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=8a6d567b-fadc-49fe-8091-a38b005e42ac, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:16:17:18:19, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=8a6d567b-fadc-49fe-8091-a38b005e42ac, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 3c1948c7 >2012-12-23 14:46:28,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [4d0dafd3] FINISH, HotPlugNicVDSCommand, log id: 3c1948c7 >2012-12-23 14:46:30,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-4) [28f88b51] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 73c5e016 >2012-12-23 14:46:30,745 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-4) [28f88b51] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@43faffbb, log id: 73c5e016 >2012-12-23 14:47:22,876 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [2a2af3f2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:47:22,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2a2af3f2] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=8a6d567b-fadc-49fe-8091-a38b005e42ac, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:16:17:18:19, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=8a6d567b-fadc-49fe-8091-a38b005e42ac, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0d, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 139fca52 >2012-12-23 14:47:23,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [2a2af3f2] FINISH, HotUnplugNicVDSCommand, log id: 139fca52 >2012-12-23 14:47:31,985 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [216f151] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:47:31,992 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [216f151] MacPoolManager::freeMac(mac = 00:15:16:17:18:19) - entered >2012-12-23 14:47:49,174 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-11) [5e422a39] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:47:49,274 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-11) [3865a062] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:47:49,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [3865a062] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=feeca07d-9784-4340-bc42-f9dcd6a74e1e, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=feeca07d-9784-4340-bc42-f9dcd6a74e1e, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 70d1c174 >2012-12-23 14:47:49,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [3865a062] FINISH, HotPlugNicVDSCommand, log id: 70d1c174 >2012-12-23 14:47:54,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-33) [6a21b0aa] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 129944cb >2012-12-23 14:47:54,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-33) [6a21b0aa] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@c7374f7, log id: 129944cb >2012-12-23 14:48:26,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [47be949f] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:26,456 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-50) [68b45d50] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:48:26,571 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [68b45d50] IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2012-12-23 14:48:26,577 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [68b45d50] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:26,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [68b45d50] Irs placed on server null failed. Proceed Failover >2012-12-23 14:48:26,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [68b45d50] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:48:26,719 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [198dadd] XML RPC error in command ListVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:27,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [68b45d50] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:48:27,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 787ab01 >2012-12-23 14:48:27,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] spmStart polling started: taskId = 8ff63b1b-c5f6-4aca-a5b2-89d6190bf4f1 >2012-12-23 14:48:27,186 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-72) [198dadd] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:28,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [68b45d50] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:48:28,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [68b45d50] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:28,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] spmStart polling ended: taskId = 8ff63b1b-c5f6-4aca-a5b2-89d6190bf4f1 task status = finished >2012-12-23 14:48:28,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:28,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] spmStart polling ended, spm status: Free >2012-12-23 14:48:28,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8ff63b1b-c5f6-4aca-a5b2-89d6190bf4f1), log id: 5bada251 >2012-12-23 14:48:28,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] FINISH, HSMClearTaskVDSCommand, log id: 5bada251 >2012-12-23 14:48:28,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [68b45d50] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@21ad3fab, log id: 787ab01 >2012-12-23 14:48:28,226 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-50) [752f04d2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:48:28,299 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:48:29,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:29,198 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-57) [6a9b590e] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:31,209 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:31,209 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-86) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:33,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:33,224 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-59) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:35,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:35,235 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-85) [4c716d46] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:37,247 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:37,247 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-93) [663d245] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:38,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [1212e7af] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:48:38,344 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [1212e7af] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:48:38,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 55e66bf0 >2012-12-23 14:48:38,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] spmStart polling started: taskId = e9e5f437-292f-454f-af24-e6df0ac58997 >2012-12-23 14:48:39,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:39,258 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-87) [3d4c3194] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:39,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [1212e7af] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:48:39,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [1212e7af] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:39,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] spmStart polling ended: taskId = e9e5f437-292f-454f-af24-e6df0ac58997 task status = finished >2012-12-23 14:48:39,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:39,438 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] spmStart polling ended, spm status: Free >2012-12-23 14:48:39,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e9e5f437-292f-454f-af24-e6df0ac58997), log id: 465d9388 >2012-12-23 14:48:39,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] FINISH, HSMClearTaskVDSCommand, log id: 465d9388 >2012-12-23 14:48:39,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [1212e7af] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2980e9cf, log id: 55e66bf0 >2012-12-23 14:48:39,462 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-7) [4e762a52] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:48:39,505 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:48:41,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:41,269 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) [4e518f73] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:43,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:43,280 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-3) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:45,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:45,292 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-84) [6b4d690d] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:47,307 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:47,307 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-75) [3c487466] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:49,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:49,324 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-77) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:49,532 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:48:49,557 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:48:49,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 64e60416 >2012-12-23 14:48:49,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) spmStart polling started: taskId = 8ae353b7-9fc5-40ee-9eef-524571318689 >2012-12-23 14:48:51,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:51,335 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-16) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:53,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:53,347 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:55,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:55,357 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-21) [7a94683b] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:57,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:57,368 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-90) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:48:58,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:48:58,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:58,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) spmStart polling ended: taskId = 8ae353b7-9fc5-40ee-9eef-524571318689 task status = finished >2012-12-23 14:48:58,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:48:58,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) spmStart polling ended, spm status: Free >2012-12-23 14:48:58,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8ae353b7-9fc5-40ee-9eef-524571318689), log id: 730b634c >2012-12-23 14:48:58,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) FINISH, HSMClearTaskVDSCommand, log id: 730b634c >2012-12-23 14:48:58,836 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@70a44d95, log id: 64e60416 >2012-12-23 14:48:58,840 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [32e1aaf9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:48:58,901 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:48:59,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:48:59,380 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-11) [20ed4521] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:01,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:01,390 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-29) [337c7b8f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:03,405 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:03,405 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-92) [4cede70f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:05,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:05,417 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-35) [6966a10d] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:07,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:07,429 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) [1a8d41e7] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:08,975 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:49:08,996 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [7ab040dd] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:49:08,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4481f85d >2012-12-23 14:49:09,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] spmStart polling started: taskId = 5dec4713-5299-4625-b49c-056c66deae16 >2012-12-23 14:49:09,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:09,440 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-8) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:10,045 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [7ab040dd] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:49:10,045 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [7ab040dd] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:10,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] spmStart polling ended: taskId = 5dec4713-5299-4625-b49c-056c66deae16 task status = finished >2012-12-23 14:49:10,045 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:10,064 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] spmStart polling ended, spm status: Free >2012-12-23 14:49:10,065 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5dec4713-5299-4625-b49c-056c66deae16), log id: 35cd8feb >2012-12-23 14:49:10,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] FINISH, HSMClearTaskVDSCommand, log id: 35cd8feb >2012-12-23 14:49:10,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [7ab040dd] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@44bf745a, log id: 4481f85d >2012-12-23 14:49:10,091 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-31) [756fe3f8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:49:10,136 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:49:11,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:11,451 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-27) [38d5d554] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:13,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:13,462 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-44) [5a8fa6d6] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:18,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [30830827] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:18,472 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-12) [30830827] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:20,161 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:49:20,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [53deef55] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:49:20,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: b45778f >2012-12-23 14:49:20,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] spmStart polling started: taskId = 80bdcd21-f854-4837-8cb3-a5f660c65297 >2012-12-23 14:49:20,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:20,484 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-51) [2b28f97e] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:49:21,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [53deef55] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:49:21,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [53deef55] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:21,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] spmStart polling ended: taskId = 80bdcd21-f854-4837-8cb3-a5f660c65297 task status = finished >2012-12-23 14:49:21,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:21,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] spmStart polling ended, spm status: Free >2012-12-23 14:49:21,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) [53deef55] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=80bdcd21-f854-4837-8cb3-a5f660c65297), log id: f4de4b9 >2012-12-23 14:49:21,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) [53deef55] FINISH, HSMClearTaskVDSCommand, log id: f4de4b9 >2012-12-23 14:49:21,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [53deef55] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@42e33588, log id: b45778f >2012-12-23 14:49:21,290 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-55) [52cf9606] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:49:21,354 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:49:22,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:22,496 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-81) [49f3c5ee] VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 14:49:22,540 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-50) [49f3c5ee] ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:49:22,601 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-50) [379fd40b] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 14:49:24,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:26,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:29,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:31,322 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:31,382 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:49:31,393 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [16bffbec] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:49:31,395 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7227604 >2012-12-23 14:49:31,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] spmStart polling started: taskId = acaaecf5-0458-4da9-ade6-7ea2085e47d9 >2012-12-23 14:49:33,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:35,405 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:37,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:39,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [198dadd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:39,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [16bffbec] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:49:39,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [16bffbec] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:39,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] spmStart polling ended: taskId = acaaecf5-0458-4da9-ade6-7ea2085e47d9 task status = finished >2012-12-23 14:49:39,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:39,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] spmStart polling ended, spm status: Free >2012-12-23 14:49:39,633 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=acaaecf5-0458-4da9-ade6-7ea2085e47d9), log id: fe50133 >2012-12-23 14:49:39,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] FINISH, HSMClearTaskVDSCommand, log id: fe50133 >2012-12-23 14:49:39,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [16bffbec] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3b1c36c, log id: 7227604 >2012-12-23 14:49:39,655 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [b94e959] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:49:39,737 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:49:41,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:44,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:46,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:48,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:49,774 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:49:49,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) [7125dfbf] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:49:49,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5aace815 >2012-12-23 14:49:49,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] spmStart polling started: taskId = 0a451da4-d8ea-47c4-96de-23b75deb5692 >2012-12-23 14:49:50,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:50,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-56) [7125dfbf] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:49:50,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-56) [7125dfbf] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:50,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] spmStart polling ended: taskId = 0a451da4-d8ea-47c4-96de-23b75deb5692 task status = finished >2012-12-23 14:49:50,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:49:50,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] spmStart polling ended, spm status: Free >2012-12-23 14:49:50,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0a451da4-d8ea-47c4-96de-23b75deb5692), log id: 479e26d1 >2012-12-23 14:49:50,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] FINISH, HSMClearTaskVDSCommand, log id: 479e26d1 >2012-12-23 14:49:50,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-56) [7125dfbf] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@60068812, log id: 5aace815 >2012-12-23 14:49:50,909 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-56) [4ccf86fe] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:49:50,942 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:49:52,543 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:54,612 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:49:56,654 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [14a1b8ec] Checking autorecoverable hosts >2012-12-23 14:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [14a1b8ec] Autorecovering 0 hosts >2012-12-23 14:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [14a1b8ec] Checking autorecoverable hosts done >2012-12-23 14:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-2) [14a1b8ec] Autorecovering storage domains is disabled, skipping >2012-12-23 14:50:00,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [368d7d04] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:50:00,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [368d7d04] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:50:00,983 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 316bdbaf >2012-12-23 14:50:01,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] spmStart polling started: taskId = 29644c62-3a0f-4a15-95f9-dd40ebdaceaf >2012-12-23 14:50:02,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [368d7d04] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:50:02,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [368d7d04] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:02,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] spmStart polling ended: taskId = 29644c62-3a0f-4a15-95f9-dd40ebdaceaf task status = finished >2012-12-23 14:50:02,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:02,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] spmStart polling ended, spm status: Free >2012-12-23 14:50:02,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=29644c62-3a0f-4a15-95f9-dd40ebdaceaf), log id: 74ed71bc >2012-12-23 14:50:02,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] FINISH, HSMClearTaskVDSCommand, log id: 74ed71bc >2012-12-23 14:50:02,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [368d7d04] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@10c6299d, log id: 316bdbaf >2012-12-23 14:50:02,073 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [41d60b05] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:50:02,221 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [41d60b05] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:50:12,247 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:50:12,293 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [7a94683b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:50:12,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 50dc336e >2012-12-23 14:50:12,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] spmStart polling started: taskId = f77fa6de-6745-4724-a4f9-0baf675224f3 >2012-12-23 14:50:20,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [7a94683b] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:50:20,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [7a94683b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:20,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] spmStart polling ended: taskId = f77fa6de-6745-4724-a4f9-0baf675224f3 task status = finished >2012-12-23 14:50:20,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:20,518 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] spmStart polling ended, spm status: Free >2012-12-23 14:50:20,519 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f77fa6de-6745-4724-a4f9-0baf675224f3), log id: 4d3bb81a >2012-12-23 14:50:20,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] FINISH, HSMClearTaskVDSCommand, log id: 4d3bb81a >2012-12-23 14:50:20,538 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [7a94683b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@bb3da93, log id: 50dc336e >2012-12-23 14:50:20,540 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [4cd2eee5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:50:20,574 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:50:30,615 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [6a21b0aa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:50:30,650 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [6a21b0aa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:50:30,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 72409050 >2012-12-23 14:50:30,677 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] spmStart polling started: taskId = 9a972a62-cc4e-44c2-b956-540d4c3a5f22 >2012-12-23 14:50:31,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [6a21b0aa] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:50:31,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [6a21b0aa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:31,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] spmStart polling ended: taskId = 9a972a62-cc4e-44c2-b956-540d4c3a5f22 task status = finished >2012-12-23 14:50:31,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:31,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] spmStart polling ended, spm status: Free >2012-12-23 14:50:31,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9a972a62-cc4e-44c2-b956-540d4c3a5f22), log id: 7cd79c70 >2012-12-23 14:50:31,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] FINISH, HSMClearTaskVDSCommand, log id: 7cd79c70 >2012-12-23 14:50:31,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [6a21b0aa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f5fbd18, log id: 72409050 >2012-12-23 14:50:31,740 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-33) [36778af4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:50:32,155 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:50:42,182 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [46a6786d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:50:42,486 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [46a6786d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:50:42,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 540cc1fe >2012-12-23 14:50:42,512 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] spmStart polling started: taskId = ee79b44a-1b69-472e-8a02-e4def7d60e5b >2012-12-23 14:50:43,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [46a6786d] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:50:43,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [46a6786d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:43,537 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] spmStart polling ended: taskId = ee79b44a-1b69-472e-8a02-e4def7d60e5b task status = finished >2012-12-23 14:50:43,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:50:43,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] spmStart polling ended, spm status: Free >2012-12-23 14:50:43,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ee79b44a-1b69-472e-8a02-e4def7d60e5b), log id: 5700f2dd >2012-12-23 14:50:43,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] FINISH, HSMClearTaskVDSCommand, log id: 5700f2dd >2012-12-23 14:50:43,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [46a6786d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7f48b7ca, log id: 540cc1fe >2012-12-23 14:50:43,586 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-39) [7f1a700e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:50:43,671 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [7f1a700e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:50:53,697 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:50:53,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [97ba4d5] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:50:53,717 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 317700c6 >2012-12-23 14:50:53,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] spmStart polling started: taskId = f7b10577-0c0b-4061-a9d7-dab52cb75f29 >2012-12-23 14:51:01,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [97ba4d5] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:51:01,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [97ba4d5] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:01,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] spmStart polling ended: taskId = f7b10577-0c0b-4061-a9d7-dab52cb75f29 task status = finished >2012-12-23 14:51:01,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:01,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] spmStart polling ended, spm status: Free >2012-12-23 14:51:02,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f7b10577-0c0b-4061-a9d7-dab52cb75f29), log id: cb1318f >2012-12-23 14:51:02,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] FINISH, HSMClearTaskVDSCommand, log id: cb1318f >2012-12-23 14:51:02,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [97ba4d5] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@452ca9cb, log id: 317700c6 >2012-12-23 14:51:02,021 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-98) [773f71e7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:51:02,328 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:51:07,184 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [53c658c5] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:51:07,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [53c658c5] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=feeca07d-9784-4340-bc42-f9dcd6a74e1e, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=feeca07d-9784-4340-bc42-f9dcd6a74e1e, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0e, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 36601ebc >2012-12-23 14:51:07,483 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [53c658c5] FINISH, HotUnplugNicVDSCommand, log id: 36601ebc >2012-12-23 14:51:12,371 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:51:12,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [c87f25a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:51:12,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6ab9dce6 >2012-12-23 14:51:12,412 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] spmStart polling started: taskId = c9c6d60d-7b3f-4389-bb78-d17742e03594 >2012-12-23 14:51:13,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [c87f25a] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:51:13,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [c87f25a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:13,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] spmStart polling ended: taskId = c9c6d60d-7b3f-4389-bb78-d17742e03594 task status = finished >2012-12-23 14:51:13,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:13,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] spmStart polling ended, spm status: Free >2012-12-23 14:51:13,470 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c9c6d60d-7b3f-4389-bb78-d17742e03594), log id: 43da5b69 >2012-12-23 14:51:13,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] FINISH, HSMClearTaskVDSCommand, log id: 43da5b69 >2012-12-23 14:51:13,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [c87f25a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@34a76d4c, log id: 6ab9dce6 >2012-12-23 14:51:13,491 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-65) [5bf8b395] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:51:13,612 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:51:14,924 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [30c36f58] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:51:14,927 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [30c36f58] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 14:51:23,638 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:51:23,684 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [471dc8a8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:51:23,685 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3bb512b0 >2012-12-23 14:51:23,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] spmStart polling started: taskId = 11fb38b2-ebd4-4c45-86b6-199750754ee8 >2012-12-23 14:51:24,730 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) [471dc8a8] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:51:24,731 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) [471dc8a8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:24,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] spmStart polling ended: taskId = 11fb38b2-ebd4-4c45-86b6-199750754ee8 task status = finished >2012-12-23 14:51:24,731 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:24,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] spmStart polling ended, spm status: Free >2012-12-23 14:51:24,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=11fb38b2-ebd4-4c45-86b6-199750754ee8), log id: 608521e >2012-12-23 14:51:24,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] FINISH, HSMClearTaskVDSCommand, log id: 608521e >2012-12-23 14:51:24,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [471dc8a8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@c4732aa, log id: 3bb512b0 >2012-12-23 14:51:24,783 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-82) [164f3d32] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:51:24,822 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:51:34,877 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:51:35,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [663d245] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:51:35,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 476aa2e3 >2012-12-23 14:51:35,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] spmStart polling started: taskId = 79feaf7d-b77a-4662-bc1a-0b80e3241e09 >2012-12-23 14:51:42,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [663d245] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:51:42,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [663d245] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:42,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] spmStart polling ended: taskId = 79feaf7d-b77a-4662-bc1a-0b80e3241e09 task status = finished >2012-12-23 14:51:42,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:42,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] spmStart polling ended, spm status: Free >2012-12-23 14:51:42,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [663d245] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=79feaf7d-b77a-4662-bc1a-0b80e3241e09), log id: 1f01cbcb >2012-12-23 14:51:42,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [663d245] FINISH, HSMClearTaskVDSCommand, log id: 1f01cbcb >2012-12-23 14:51:42,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [663d245] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2eea8c54, log id: 476aa2e3 >2012-12-23 14:51:42,343 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-93) [28a2f6dc] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:51:42,466 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:51:52,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:51:52,909 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:51:52,911 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 58c6e045 >2012-12-23 14:51:52,934 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) spmStart polling started: taskId = 5ca68494-07b2-4018-aced-9dad0f638286 >2012-12-23 14:51:53,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:51:53,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:53,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) spmStart polling ended: taskId = 5ca68494-07b2-4018-aced-9dad0f638286 task status = finished >2012-12-23 14:51:53,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:51:53,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) spmStart polling ended, spm status: Free >2012-12-23 14:51:53,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-77) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5ca68494-07b2-4018-aced-9dad0f638286), log id: 5d5dbed1 >2012-12-23 14:51:53,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-77) FINISH, HSMClearTaskVDSCommand, log id: 5d5dbed1 >2012-12-23 14:51:53,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@359abb3a, log id: 58c6e045 >2012-12-23 14:51:53,998 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-77) [4179f854] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:51:54,049 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [4179f854] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:52:04,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:52:04,087 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:52:04,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 211ce77b >2012-12-23 14:52:04,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) spmStart polling started: taskId = 804fd43c-91f6-485f-80ef-a188c07ed918 >2012-12-23 14:52:05,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:52:05,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:05,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) spmStart polling ended: taskId = 804fd43c-91f6-485f-80ef-a188c07ed918 task status = finished >2012-12-23 14:52:05,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:05,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) spmStart polling ended, spm status: Free >2012-12-23 14:52:05,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=804fd43c-91f6-485f-80ef-a188c07ed918), log id: 792205c >2012-12-23 14:52:05,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) FINISH, HSMClearTaskVDSCommand, log id: 792205c >2012-12-23 14:52:05,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@a8a7be6, log id: 211ce77b >2012-12-23 14:52:05,177 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [9cc3e72] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:52:05,208 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [9cc3e72] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:52:15,233 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:52:15,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [6966a10d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:52:15,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 697d7257 >2012-12-23 14:52:15,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] spmStart polling started: taskId = 84d0323d-80b1-4d75-af4e-82f0233e1c7a >2012-12-23 14:52:23,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [6966a10d] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:52:23,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [6966a10d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:23,505 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] spmStart polling ended: taskId = 84d0323d-80b1-4d75-af4e-82f0233e1c7a task status = finished >2012-12-23 14:52:23,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:23,524 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] spmStart polling ended, spm status: Free >2012-12-23 14:52:23,526 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=84d0323d-80b1-4d75-af4e-82f0233e1c7a), log id: 4a0384 >2012-12-23 14:52:23,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] FINISH, HSMClearTaskVDSCommand, log id: 4a0384 >2012-12-23 14:52:23,545 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [6966a10d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7b2ccf41, log id: 697d7257 >2012-12-23 14:52:23,548 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-35) [3adaf394] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:52:23,635 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:52:23,662 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-5) [1b2dc387] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:52:23,793 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-5) [454e68a2] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:52:23,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-5) [454e68a2] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=7a2ec731-91c3-4084-93c8-a3e3d3d82df2, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:ab, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=7a2ec731-91c3-4084-93c8-a3e3d3d82df2, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 4d9dc2c2 >2012-12-23 14:52:24,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-5) [454e68a2] FINISH, HotPlugNicVDSCommand, log id: 4d9dc2c2 >2012-12-23 14:52:33,666 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:52:33,681 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:52:33,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6f20299d >2012-12-23 14:52:33,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) spmStart polling started: taskId = 16051323-ce35-40e6-93bc-3ed8c28af9d7 >2012-12-23 14:52:34,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:52:34,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:34,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) spmStart polling ended: taskId = 16051323-ce35-40e6-93bc-3ed8c28af9d7 task status = finished >2012-12-23 14:52:34,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:34,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) spmStart polling ended, spm status: Free >2012-12-23 14:52:34,751 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=16051323-ce35-40e6-93bc-3ed8c28af9d7), log id: 4e43bcb >2012-12-23 14:52:34,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) FINISH, HSMClearTaskVDSCommand, log id: 4e43bcb >2012-12-23 14:52:34,771 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@24118eef, log id: 6f20299d >2012-12-23 14:52:34,774 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-28) [7cbeff68] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:52:34,861 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7cbeff68] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:52:44,890 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:52:44,924 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:52:44,926 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3c2220f >2012-12-23 14:52:44,951 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) spmStart polling started: taskId = cf8404d5-1c9f-4c6d-bee2-faa2cbc2d775 >2012-12-23 14:52:45,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:52:45,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:45,972 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) spmStart polling ended: taskId = cf8404d5-1c9f-4c6d-bee2-faa2cbc2d775 task status = finished >2012-12-23 14:52:45,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:52:45,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) spmStart polling ended, spm status: Free >2012-12-23 14:52:45,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-46) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=cf8404d5-1c9f-4c6d-bee2-faa2cbc2d775), log id: 6b03d651 >2012-12-23 14:52:46,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-46) FINISH, HSMClearTaskVDSCommand, log id: 6b03d651 >2012-12-23 14:52:46,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@48eb96ba, log id: 3c2220f >2012-12-23 14:52:46,013 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-46) [62f4b2bc] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:52:46,055 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:52:56,080 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [896989f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:52:56,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [896989f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:52:56,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6de58ff9 >2012-12-23 14:52:56,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] spmStart polling started: taskId = 372e62c2-122a-4382-ae2e-6d270b30b9c0 >2012-12-23 14:52:59,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 14:53:01,653 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-47) [cf0bfb8] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:53:02,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5bfed1c6 >2012-12-23 14:53:02,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 5bfed1c6 >2012-12-23 14:53:02,180 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-47) [2b0481fe] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:53:02,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7c25e755 >2012-12-23 14:53:02,209 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 7c25e755 >2012-12-23 14:53:02,210 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-47) [2b0481fe] Host orchid-vds1 storage connection was succeeded >2012-12-23 14:53:02,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 6eb70f0d >2012-12-23 14:53:02,254 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-47) [2b0481fe] FINISH, ConnectStoragePoolVDSCommand, log id: 6eb70f0d >2012-12-23 14:53:02,310 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-47) [2b0481fe] No string for UNASSIGNED type. Use default Log >2012-12-23 14:53:02,312 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-49) [2b0481fe] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:53:02,332 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-47) [5555ea3e] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:53:02,347 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-47) [21a14b18] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 14:53:04,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [896989f] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:53:04,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-48) [896989f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:53:04,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] spmStart polling ended: taskId = 372e62c2-122a-4382-ae2e-6d270b30b9c0 task status = finished >2012-12-23 14:53:04,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:53:04,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] spmStart polling ended, spm status: Free >2012-12-23 14:53:04,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-48) [896989f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=372e62c2-122a-4382-ae2e-6d270b30b9c0), log id: 70540409 >2012-12-23 14:53:04,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-48) [896989f] FINISH, HSMClearTaskVDSCommand, log id: 70540409 >2012-12-23 14:53:04,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-48) [896989f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1bd5247c, log id: 6de58ff9 >2012-12-23 14:53:04,404 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-48) [464e572a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:53:04,486 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:53:04,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] Irs placed on server null failed. Proceed Failover >2012-12-23 14:53:04,549 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] hostFromVds::selectedVds - orchid-vds1, spmStatus SPM, storage pool DC31-CLI >2012-12-23 14:53:04,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] Initialize Irs proxy from vds: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:53:04,617 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 60aef0bd >2012-12-23 14:53:04,737 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 14:53:04,738 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] START, HSMGetAllTasksInfoVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: 3b2a2a92 >2012-12-23 14:53:04,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 3b2a2a92 >2012-12-23 14:53:04,761 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 60aef0bd >2012-12-23 14:53:04,761 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-50) [752f04d2] Discovered no tasks on Storage Pool DC31-CLI >2012-12-23 14:53:06,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) [164f3d32] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 11af3212 >2012-12-23 14:53:06,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-82) [164f3d32] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@50044d0, log id: 11af3212 >2012-12-23 14:53:15,427 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [d2d092c] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:53:15,430 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [d2d092c] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=7a2ec731-91c3-4084-93c8-a3e3d3d82df2, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:ab, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=7a2ec731-91c3-4084-93c8-a3e3d3d82df2, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x0f, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 33e07215 >2012-12-23 14:53:16,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [d2d092c] FINISH, HotUnplugNicVDSCommand, log id: 33e07215 >2012-12-23 14:53:20,518 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-50) [54a7138c] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:53:20,523 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-50) [54a7138c] MacPoolManager::freeMac(mac = 00:15:17:3d:cd:ab) - entered >2012-12-23 14:53:32,597 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-1) [23a4bb6f] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:53:32,707 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-1) [52ceca60] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:53:32,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-1) [52ceca60] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=30e6aef2-0034-46fd-b079-ae82ead79db6, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:ab, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=30e6aef2-0034-46fd-b079-ae82ead79db6, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 7733d281 >2012-12-23 14:53:33,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-1) [52ceca60] FINISH, HotPlugNicVDSCommand, log id: 7733d281 >2012-12-23 14:53:38,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-10) [3cd99e52] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 798e99a0 >2012-12-23 14:53:38,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-10) [3cd99e52] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@10815b9, log id: 798e99a0 >2012-12-23 14:54:21,891 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [36160894] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:54:21,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [36160894] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=30e6aef2-0034-46fd-b079-ae82ead79db6, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:ab, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=30e6aef2-0034-46fd-b079-ae82ead79db6, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x10, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4e6a566b >2012-12-23 14:54:22,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [36160894] FINISH, HotUnplugNicVDSCommand, log id: 4e6a566b >2012-12-23 14:54:26,833 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [385bf29f] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:54:26,835 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [385bf29f] MacPoolManager::freeMac(mac = 00:15:17:3d:cd:ab) - entered >2012-12-23 14:54:42,144 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-3) [10a4ab23] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:54:42,258 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-3) [68915f78] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:54:42,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [68915f78] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=ce575204-74ca-4ee7-b11d-063ea095a306, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:a0, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=ce575204-74ca-4ee7-b11d-063ea095a306, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 42252c6e >2012-12-23 14:54:42,761 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [68915f78] FINISH, HotPlugNicVDSCommand, log id: 42252c6e >2012-12-23 14:54:51,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) [1a8d41e7] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 60e94440 >2012-12-23 14:54:51,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-18) [1a8d41e7] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@727ff774, log id: 60e94440 >2012-12-23 14:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [7f1a700e] Checking autorecoverable hosts >2012-12-23 14:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [7f1a700e] Autorecovering 0 hosts >2012-12-23 14:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [7f1a700e] Checking autorecoverable hosts done >2012-12-23 14:55:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-39) [7f1a700e] Autorecovering storage domains is disabled, skipping >2012-12-23 14:56:01,502 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-49) [3857d019] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:56:01,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [3857d019] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=ce575204-74ca-4ee7-b11d-063ea095a306, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:15:17:3d:cd:a0, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=ce575204-74ca-4ee7-b11d-063ea095a306, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x11, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: b8bb392 >2012-12-23 14:56:02,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-49) [3857d019] FINISH, HotUnplugNicVDSCommand, log id: b8bb392 >2012-12-23 14:56:06,370 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [53a3304] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:56:06,375 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [53a3304] MacPoolManager::freeMac(mac = 00:15:17:3d:cd:a0) - entered >2012-12-23 14:57:02,778 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [30acb3e6] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:57:02,978 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [2649ff45] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 14:57:02,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [2649ff45] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=78649825-171c-4c7d-aeac-1a9b44ab7039, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=78649825-171c-4c7d-aeac-1a9b44ab7039, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 79018458 >2012-12-23 14:57:03,461 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-10) [2649ff45] FINISH, HotPlugNicVDSCommand, log id: 79018458 >2012-12-23 14:57:06,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-95) [fbf7edf] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 7e82fa0c >2012-12-23 14:57:06,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-95) [fbf7edf] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@48ee6ab7, log id: 7e82fa0c >2012-12-23 14:58:10,885 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetStatsVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:10,886 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-89) vds::refreshVdsStats Failed getVdsStats, vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, error = VDSNetworkException: VDSNetworkException: >2012-12-23 14:58:10,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:10,892 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-13) [3489947e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:58:11,197 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:11,238 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [3489947e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2012-12-23 14:58:11,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [3489947e] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:11,245 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [3489947e] Irs placed on server null failed. Proceed Failover >2012-12-23 14:58:11,271 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [3489947e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:58:11,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [3489947e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:58:11,317 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5d0e629f >2012-12-23 14:58:11,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] spmStart polling started: taskId = c2d075a3-23d2-4bcc-b358-dbf3526b0f8e >2012-12-23 14:58:13,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:13,211 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-14) [743958a] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:13,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-13) [3489947e] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:58:13,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-13) [3489947e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:13,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] spmStart polling ended: taskId = c2d075a3-23d2-4bcc-b358-dbf3526b0f8e task status = finished >2012-12-23 14:58:13,393 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:13,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] spmStart polling ended, spm status: Free >2012-12-23 14:58:13,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-13) [3489947e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c2d075a3-23d2-4bcc-b358-dbf3526b0f8e), log id: 31a070b2 >2012-12-23 14:58:13,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-13) [3489947e] FINISH, HSMClearTaskVDSCommand, log id: 31a070b2 >2012-12-23 14:58:13,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [3489947e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1c46cf92, log id: 5d0e629f >2012-12-23 14:58:13,445 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-13) [6ce588be] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:58:13,498 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [6ce588be] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:58:15,222 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:15,222 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-17) [32e1aaf9] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:17,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [257bff21] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:17,233 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-22) [257bff21] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:19,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:19,245 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-29) [337c7b8f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:21,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3cd99e52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:21,255 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-10) [3cd99e52] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:23,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:23,266 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-100) [4a6f1214] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:23,531 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:58:23,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [255722ba] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:58:23,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5ea4438d >2012-12-23 14:58:23,576 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] spmStart polling started: taskId = 691820c8-54d8-44f9-9fab-96c4cce120ac >2012-12-23 14:58:24,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [255722ba] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:58:24,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [255722ba] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:24,599 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] spmStart polling ended: taskId = 691820c8-54d8-44f9-9fab-96c4cce120ac task status = finished >2012-12-23 14:58:24,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:24,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] spmStart polling ended, spm status: Free >2012-12-23 14:58:24,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [255722ba] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=691820c8-54d8-44f9-9fab-96c4cce120ac), log id: 118326ee >2012-12-23 14:58:24,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [255722ba] FINISH, HSMClearTaskVDSCommand, log id: 118326ee >2012-12-23 14:58:24,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [255722ba] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5306b688, log id: 5ea4438d >2012-12-23 14:58:24,644 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-20) [5db9c54d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:58:24,719 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [5db9c54d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:58:25,277 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:25,277 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-8) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:27,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:27,287 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-35) [3adaf394] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:29,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:29,298 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-34) [5b426f64] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:31,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:31,309 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-40) [6b7660a2] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:33,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:33,320 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-45) [544d62aa] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:34,746 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [7f1a700e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:58:34,792 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [7f1a700e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:58:34,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 33259050 >2012-12-23 14:58:34,835 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] spmStart polling started: taskId = 06ce1854-85e4-4a85-8436-a89110d573f7 >2012-12-23 14:58:35,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:35,331 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-52) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:35,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [7f1a700e] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:58:35,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-39) [7f1a700e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:35,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] spmStart polling ended: taskId = 06ce1854-85e4-4a85-8436-a89110d573f7 task status = finished >2012-12-23 14:58:35,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:35,876 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] spmStart polling ended, spm status: Free >2012-12-23 14:58:35,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=06ce1854-85e4-4a85-8436-a89110d573f7), log id: 6e13caf5 >2012-12-23 14:58:35,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] FINISH, HSMClearTaskVDSCommand, log id: 6e13caf5 >2012-12-23 14:58:35,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-39) [7f1a700e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5571d348, log id: 33259050 >2012-12-23 14:58:35,898 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-39) [23e647cb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:58:35,924 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:58:37,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:37,343 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-51) [2b28f97e] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:39,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:39,354 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-81) [49f3c5ee] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:41,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:41,366 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-37) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:43,376 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:43,376 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-43) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:45,387 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:45,387 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-98) [773f71e7] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:45,951 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:58:45,961 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [13427c0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:58:45,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3fc0f0f9 >2012-12-23 14:58:45,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] spmStart polling started: taskId = 0ca23f8d-a1c0-4270-a096-d468c22f603b >2012-12-23 14:58:47,401 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:47,401 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-66) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:49,412 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:49,412 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-65) [5bf8b395] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:51,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:51,427 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-42) [5728d6f0] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:53,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [13427c0] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:58:53,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [13427c0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:53,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] spmStart polling ended: taskId = 0ca23f8d-a1c0-4270-a096-d468c22f603b task status = finished >2012-12-23 14:58:53,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:58:53,187 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] spmStart polling ended, spm status: Free >2012-12-23 14:58:53,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [13427c0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0ca23f8d-a1c0-4270-a096-d468c22f603b), log id: 68985663 >2012-12-23 14:58:53,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [13427c0] FINISH, HSMClearTaskVDSCommand, log id: 68985663 >2012-12-23 14:58:53,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [13427c0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@694fb33a, log id: 3fc0f0f9 >2012-12-23 14:58:53,216 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-62) [6f7fdad9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:58:53,268 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:58:53,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:53,437 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-74) [6ec63335] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:55,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:55,446 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-36) [b94e959] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:57,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:57,458 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-50) [752f04d2] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:58:59,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:58:59,470 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-86) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:01,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:59:01,482 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-79) [63986237] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:03,295 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:59:03,335 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:59:03,337 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7351155d >2012-12-23 14:59:03,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) spmStart polling started: taskId = 4510968a-f59b-4978-a397-0be3e9b89a99 >2012-12-23 14:59:03,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [3c2192c2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:59:03,493 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-53) [3c2192c2] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:04,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) Failed in HSMGetTaskStatusVDS method >2012-12-23 14:59:04,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:04,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) spmStart polling ended: taskId = 4510968a-f59b-4978-a397-0be3e9b89a99 task status = finished >2012-12-23 14:59:04,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:04,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) spmStart polling ended, spm status: Free >2012-12-23 14:59:04,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4510968a-f59b-4978-a397-0be3e9b89a99), log id: 4c0352 >2012-12-23 14:59:04,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) FINISH, HSMClearTaskVDSCommand, log id: 4c0352 >2012-12-23 14:59:04,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7e6dfca4, log id: 7351155d >2012-12-23 14:59:04,423 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-59) [66e5b3d4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:59:04,498 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [66e5b3d4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:59:05,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:59:05,509 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-88) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:07,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:59:07,534 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-87) [3d4c3194] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:09,545 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 14:59:09,545 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) [4e518f73] VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 14:59:09,561 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-50) [4e518f73] ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 14:59:09,620 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-50) [49e71afc] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 14:59:13,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command ListVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 14:59:13,736 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-93) [28a2f6dc] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 14:59:17,488 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-71) [450f6d65] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 14:59:17,579 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-71) [2fa5812f] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:59:17,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-71) [2fa5812f] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7b57ba79 >2012-12-23 14:59:17,624 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-71) [2fa5812f] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 7b57ba79 >2012-12-23 14:59:17,625 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-71) [2fa5812f] Host orchid-vds2 storage connection was succeeded >2012-12-23 14:59:17,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-71) [2fa5812f] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 7521d4c0 >2012-12-23 14:59:17,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-71) [2fa5812f] FINISH, ConnectStoragePoolVDSCommand, log id: 7521d4c0 >2012-12-23 14:59:17,740 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-71) [2fa5812f] No string for UNASSIGNED type. Use default Log >2012-12-23 14:59:17,742 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) [2fa5812f] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 14:59:17,789 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-71) [2adf0dcc] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 14:59:17,804 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-71) [6668e99] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 14:59:24,543 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [41d60b05] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:59:24,570 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [41d60b05] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:59:24,572 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5e8be857 >2012-12-23 14:59:24,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] spmStart polling started: taskId = 63473167-f4e1-4bbc-be2e-deb84a1ade8e >2012-12-23 14:59:26,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [41d60b05] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:59:26,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-38) [41d60b05] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:26,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] spmStart polling ended: taskId = 63473167-f4e1-4bbc-be2e-deb84a1ade8e task status = finished >2012-12-23 14:59:26,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:26,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] spmStart polling ended, spm status: Free >2012-12-23 14:59:26,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=63473167-f4e1-4bbc-be2e-deb84a1ade8e), log id: 510cef5f >2012-12-23 14:59:26,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] FINISH, HSMClearTaskVDSCommand, log id: 510cef5f >2012-12-23 14:59:26,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-38) [41d60b05] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@28376f8b, log id: 5e8be857 >2012-12-23 14:59:26,658 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-38) [4f7c234d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:59:27,170 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:59:37,207 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [9cc3e72] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:59:37,250 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [9cc3e72] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:59:37,252 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2ea56125 >2012-12-23 14:59:37,275 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] spmStart polling started: taskId = f3a9a7a6-e015-4ce2-95a0-1c6f8339a61c >2012-12-23 14:59:38,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [9cc3e72] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:59:38,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [9cc3e72] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:38,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] spmStart polling ended: taskId = f3a9a7a6-e015-4ce2-95a0-1c6f8339a61c task status = finished >2012-12-23 14:59:38,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:38,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] spmStart polling ended, spm status: Free >2012-12-23 14:59:38,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f3a9a7a6-e015-4ce2-95a0-1c6f8339a61c), log id: 2cb4328d >2012-12-23 14:59:38,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] FINISH, HSMClearTaskVDSCommand, log id: 2cb4328d >2012-12-23 14:59:38,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [9cc3e72] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6a62dde8, log id: 2ea56125 >2012-12-23 14:59:38,383 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [d6e0e9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:59:38,414 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [d6e0e9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 14:59:48,461 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 14:59:48,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [8fdb695] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 14:59:48,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7d9554ca >2012-12-23 14:59:48,498 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] spmStart polling started: taskId = ee5ec374-70df-4bd7-ab0c-930ba76658a0 >2012-12-23 14:59:55,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [8fdb695] Failed in HSMGetTaskStatusVDS method >2012-12-23 14:59:55,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-99) [8fdb695] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:55,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] spmStart polling ended: taskId = ee5ec374-70df-4bd7-ab0c-930ba76658a0 task status = finished >2012-12-23 14:59:55,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 14:59:55,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] spmStart polling ended, spm status: Free >2012-12-23 14:59:55,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ee5ec374-70df-4bd7-ab0c-930ba76658a0), log id: 7fb511b4 >2012-12-23 14:59:55,695 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] FINISH, HSMClearTaskVDSCommand, log id: 7fb511b4 >2012-12-23 14:59:55,695 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-99) [8fdb695] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@489d81ec, log id: 7d9554ca >2012-12-23 14:59:55,697 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-99) [5cbcd232] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 14:59:55,742 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) [594628df] Checking autorecoverable hosts >2012-12-23 15:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) [594628df] Autorecovering 0 hosts >2012-12-23 15:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) [594628df] Checking autorecoverable hosts done >2012-12-23 15:00:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-6) [594628df] Autorecovering storage domains is disabled, skipping >2012-12-23 15:00:05,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:00:05,789 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:00:05,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3781588b >2012-12-23 15:00:05,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) spmStart polling started: taskId = 1d7e96c0-5fe9-4b3f-9707-12ca5dffad00 >2012-12-23 15:00:06,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:00:06,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:00:06,837 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) spmStart polling ended: taskId = 1d7e96c0-5fe9-4b3f-9707-12ca5dffad00 task status = finished >2012-12-23 15:00:06,837 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:00:06,856 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) spmStart polling ended, spm status: Free >2012-12-23 15:00:06,857 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1d7e96c0-5fe9-4b3f-9707-12ca5dffad00), log id: 6d418507 >2012-12-23 15:00:06,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) FINISH, HSMClearTaskVDSCommand, log id: 6d418507 >2012-12-23 15:00:06,875 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6884c69a, log id: 3781588b >2012-12-23 15:00:06,877 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-52) [650ade11] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:00:07,529 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:00:17,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:00:17,647 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [605e3fe7] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:00:17,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5963e0d1 >2012-12-23 15:00:17,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] spmStart polling started: taskId = 0cf42cf3-9777-4dc4-98b4-f6ba3652855e >2012-12-23 15:00:18,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [605e3fe7] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:00:18,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-60) [605e3fe7] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:00:18,699 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] spmStart polling ended: taskId = 0cf42cf3-9777-4dc4-98b4-f6ba3652855e task status = finished >2012-12-23 15:00:18,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:00:18,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] spmStart polling ended, spm status: Free >2012-12-23 15:00:18,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0cf42cf3-9777-4dc4-98b4-f6ba3652855e), log id: e596597 >2012-12-23 15:00:18,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] FINISH, HSMClearTaskVDSCommand, log id: e596597 >2012-12-23 15:00:18,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-60) [605e3fe7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@f1ca3dd, log id: 5963e0d1 >2012-12-23 15:00:18,743 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-60) [214a09eb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:00:18,769 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:00:59,807 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:00:59,818 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:00:59,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 316e6bd >2012-12-23 15:00:59,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) spmStart polling started: taskId = 7dff6d0c-b420-469c-8833-65ab96b25651 >2012-12-23 15:01:00,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:01:00,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-66) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:00,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) spmStart polling ended: taskId = 7dff6d0c-b420-469c-8833-65ab96b25651 task status = finished >2012-12-23 15:01:00,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:00,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) spmStart polling ended, spm status: Free >2012-12-23 15:01:00,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-66) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7dff6d0c-b420-469c-8833-65ab96b25651), log id: 51d2b449 >2012-12-23 15:01:00,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-66) FINISH, HSMClearTaskVDSCommand, log id: 51d2b449 >2012-12-23 15:01:00,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-66) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@603a4e96, log id: 316e6bd >2012-12-23 15:01:00,914 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-66) [13fd8b35] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:01:00,983 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:01:11,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:01:11,046 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:01:11,048 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 65e9ce42 >2012-12-23 15:01:11,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) spmStart polling started: taskId = 066e6973-6e1b-49e6-bab7-0405b631a16b >2012-12-23 15:01:17,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:01:17,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:17,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) spmStart polling ended: taskId = 066e6973-6e1b-49e6-bab7-0405b631a16b task status = finished >2012-12-23 15:01:17,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:17,236 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) spmStart polling ended, spm status: Free >2012-12-23 15:01:17,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-88) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=066e6973-6e1b-49e6-bab7-0405b631a16b), log id: 174b71dd >2012-12-23 15:01:17,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-88) FINISH, HSMClearTaskVDSCommand, log id: 174b71dd >2012-12-23 15:01:17,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5a20701d, log id: 65e9ce42 >2012-12-23 15:01:17,258 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-88) [7a0ae25] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:01:17,355 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:01:24,549 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [63184fe2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:01:24,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [63184fe2] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=78649825-171c-4c7d-aeac-1a9b44ab7039, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=78649825-171c-4c7d-aeac-1a9b44ab7039, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x12, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 5d60bf22 >2012-12-23 15:01:25,559 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-47) [63184fe2] Command HotUnplugNicVDS execution failed. Exception: XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 15:01:25,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [63184fe2] FINISH, HotUnplugNicVDSCommand, log id: 5d60bf22 >2012-12-23 15:01:25,560 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [63184fe2] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcRunTimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2012-12-23 15:01:27,391 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [14a1b8ec] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:01:27,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [14a1b8ec] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:01:27,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74e2fe19 >2012-12-23 15:01:27,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] spmStart polling started: taskId = 607417d6-5178-451d-bba6-41034ef95805 >2012-12-23 15:01:28,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [14a1b8ec] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:01:28,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [14a1b8ec] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:28,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] spmStart polling ended: taskId = 607417d6-5178-451d-bba6-41034ef95805 task status = finished >2012-12-23 15:01:28,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:28,476 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] spmStart polling ended, spm status: Free >2012-12-23 15:01:28,477 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=607417d6-5178-451d-bba6-41034ef95805), log id: 911a522 >2012-12-23 15:01:28,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] FINISH, HSMClearTaskVDSCommand, log id: 911a522 >2012-12-23 15:01:28,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [14a1b8ec] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@65705fd4, log id: 74e2fe19 >2012-12-23 15:01:28,498 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-2) [34a38b53] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:01:28,522 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:01:38,548 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [6ce588be] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:01:38,563 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [6ce588be] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:01:38,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5f364fff >2012-12-23 15:01:38,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] spmStart polling started: taskId = 50743525-5730-4085-bdaa-80c572f5667d >2012-12-23 15:01:39,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-13) [6ce588be] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:01:39,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-13) [6ce588be] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:39,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] spmStart polling ended: taskId = 50743525-5730-4085-bdaa-80c572f5667d task status = finished >2012-12-23 15:01:39,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:39,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] spmStart polling ended, spm status: Free >2012-12-23 15:01:39,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=50743525-5730-4085-bdaa-80c572f5667d), log id: 7666bb3c >2012-12-23 15:01:39,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] FINISH, HSMClearTaskVDSCommand, log id: 7666bb3c >2012-12-23 15:01:39,689 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-13) [6ce588be] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@528e9cde, log id: 5f364fff >2012-12-23 15:01:39,691 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-13) [10dcdd2a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:01:39,729 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:01:49,758 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3cd99e52] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:01:49,776 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3cd99e52] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:01:49,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 63d98f68 >2012-12-23 15:01:49,800 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] spmStart polling started: taskId = bf720457-097d-4fae-a2cc-8a96c1b5fead >2012-12-23 15:01:59,034 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3cd99e52] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:01:59,034 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [3cd99e52] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:59,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] spmStart polling ended: taskId = bf720457-097d-4fae-a2cc-8a96c1b5fead task status = finished >2012-12-23 15:01:59,035 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:01:59,054 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] spmStart polling ended, spm status: Free >2012-12-23 15:01:59,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bf720457-097d-4fae-a2cc-8a96c1b5fead), log id: 16dc9358 >2012-12-23 15:01:59,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] FINISH, HSMClearTaskVDSCommand, log id: 16dc9358 >2012-12-23 15:01:59,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [3cd99e52] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6b4d8221, log id: 63d98f68 >2012-12-23 15:01:59,080 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [2d9a7b90] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:01:59,129 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [2d9a7b90] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:02:09,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:02:09,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [544d62aa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:02:09,185 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 21297614 >2012-12-23 15:02:09,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] spmStart polling started: taskId = b905e7c2-eb2e-48ed-a312-00a2bbd37dff >2012-12-23 15:02:11,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 15:02:14,630 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-12) [2345771e] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 15:02:14,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-12) [36634c59] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 542d259f >2012-12-23 15:02:14,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-12) [36634c59] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 542d259f >2012-12-23 15:02:14,734 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-12) [36634c59] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:02:14,736 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-12) [36634c59] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 1416e2eb >2012-12-23 15:02:14,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-12) [36634c59] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 1416e2eb >2012-12-23 15:02:14,763 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-12) [36634c59] Host orchid-vds1 storage connection was succeeded >2012-12-23 15:02:14,780 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-12) [36634c59] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 27993a42 >2012-12-23 15:02:14,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-12) [36634c59] FINISH, ConnectStoragePoolVDSCommand, log id: 27993a42 >2012-12-23 15:02:14,929 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-12) [36634c59] No string for UNASSIGNED type. Use default Log >2012-12-23 15:02:14,931 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-47) [36634c59] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 15:02:14,981 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-12) [652445b5] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 15:02:15,004 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-12) [5e62365e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 15:02:20,538 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [544d62aa] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:02:20,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [544d62aa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:02:20,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] spmStart polling ended: taskId = b905e7c2-eb2e-48ed-a312-00a2bbd37dff task status = finished >2012-12-23 15:02:20,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:02:20,559 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] spmStart polling ended, spm status: Free >2012-12-23 15:02:20,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b905e7c2-eb2e-48ed-a312-00a2bbd37dff), log id: 7ea20465 >2012-12-23 15:02:20,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] FINISH, HSMClearTaskVDSCommand, log id: 7ea20465 >2012-12-23 15:02:20,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [544d62aa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3ecec3d6, log id: 21297614 >2012-12-23 15:02:20,594 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-45) [789b36d0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:02:20,661 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:02:20,683 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] Irs placed on server null failed. Proceed Failover >2012-12-23 15:02:21,601 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] hostFromVds::selectedVds - orchid-vds1, spmStatus SPM, storage pool DC31-CLI >2012-12-23 15:02:21,701 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] Initialize Irs proxy from vds: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 15:02:22,049 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1ea75250 >2012-12-23 15:02:22,451 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 15:02:22,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] START, HSMGetAllTasksInfoVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: 16c86255 >2012-12-23 15:02:22,474 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 16c86255 >2012-12-23 15:02:22,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: 1ea75250 >2012-12-23 15:02:22,474 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-32) [327f6ae5] Discovered no tasks on Storage Pool DC31-CLI >2012-12-23 15:03:09,856 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-10) [4e985d29] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:03:09,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [4e985d29] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=78649825-171c-4c7d-aeac-1a9b44ab7039, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=78649825-171c-4c7d-aeac-1a9b44ab7039, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x12, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 76b5b477 >2012-12-23 15:03:10,263 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [4e985d29] FINISH, HotUnplugNicVDSCommand, log id: 76b5b477 >2012-12-23 15:03:15,348 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-49) [558f5cde] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:03:15,352 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-49) [558f5cde] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 15:05:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) [66e5b3d4] Checking autorecoverable hosts >2012-12-23 15:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) [66e5b3d4] Autorecovering 0 hosts >2012-12-23 15:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) [66e5b3d4] Checking autorecoverable hosts done >2012-12-23 15:05:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-59) [66e5b3d4] Autorecovering storage domains is disabled, skipping >2012-12-23 15:07:43,742 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-11) Checking if user admin@internal is an admin, result true >2012-12-23 15:07:43,742 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-11) Running command: LoginAdminUserCommand internal: false. >2012-12-23 15:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [743958a] Checking autorecoverable hosts >2012-12-23 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [743958a] Autorecovering 0 hosts >2012-12-23 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [743958a] Checking autorecoverable hosts done >2012-12-23 15:10:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-14) [743958a] Autorecovering storage domains is disabled, skipping >2012-12-23 15:10:14,586 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [3d48d97c] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:10:14,589 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [3d48d97c] MacPoolManager::allocateNewMac entered >2012-12-23 15:10:14,589 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-9) [3d48d97c] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:59 >2012-12-23 15:10:14,693 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [51354659] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:10:14,696 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [51354659] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=4decc085-72c4-441e-ad62-77d56ca1703a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=4decc085-72c4-441e-ad62-77d56ca1703a, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 3a0408ae >2012-12-23 15:10:15,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [51354659] FINISH, HotPlugNicVDSCommand, log id: 3a0408ae >2012-12-23 15:10:23,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [542bc6ff] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 2cdb1590 >2012-12-23 15:10:23,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [542bc6ff] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6364b7f1, log id: 2cdb1590 >2012-12-23 15:12:01,480 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-11) [2cb30030] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:12:01,496 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-11) [2cb30030] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=SwXxeMb5dqO9, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 2408386d >2012-12-23 15:12:01,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-11) [2cb30030] FINISH, SetVmTicketVDSCommand, log id: 2408386d >2012-12-23 15:15:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [5b426f64] Checking autorecoverable hosts >2012-12-23 15:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [5b426f64] Autorecovering 0 hosts >2012-12-23 15:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [5b426f64] Checking autorecoverable hosts done >2012-12-23 15:15:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-34) [5b426f64] Autorecovering storage domains is disabled, skipping >2012-12-23 15:15:53,084 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-50) [515de497] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:15:53,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [515de497] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=4decc085-72c4-441e-ad62-77d56ca1703a, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=4decc085-72c4-441e-ad62-77d56ca1703a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x13, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: c3ed9aa >2012-12-23 15:15:53,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-50) [515de497] FINISH, HotUnplugNicVDSCommand, log id: c3ed9aa >2012-12-23 15:15:57,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-95) [fbf7edf] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 6827d4ed >2012-12-23 15:15:57,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-95) [fbf7edf] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@f0c4907, log id: 6827d4ed >2012-12-23 15:15:57,414 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-95) [fbf7edf] VM 80ab027c-2d2a-498a-94ec-bfb290566e65 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=4decc085-72c4-441e-ad62-77d56ca1703a, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x13, function=0x0}, managed=true, plugged=false, readOnly=false, alias=net0} >2012-12-23 15:16:02,533 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-10) [814b342] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:16:02,535 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-10) [814b342] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:59) - entered >2012-12-23 15:16:53,980 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-13) [5c59e9f] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:16:54,065 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-13) [6c5976e] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:16:54,067 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-13) [6c5976e] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=bec2c1e1-2de3-41fc-8e7a-fbfdee5999e6, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=fe:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=bec2c1e1-2de3-41fc-8e7a-fbfdee5999e6, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 7eee816f >2012-12-23 15:16:54,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-13) [6c5976e] FINISH, HotPlugNicVDSCommand, log id: 7eee816f >2012-12-23 15:16:59,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-4) [28f88b51] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 323ddf7b >2012-12-23 15:16:59,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-4) [28f88b51] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@7c1b1e01, log id: 323ddf7b >2012-12-23 15:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) [4a6ef728] Checking autorecoverable hosts >2012-12-23 15:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) [4a6ef728] Autorecovering 0 hosts >2012-12-23 15:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) [4a6ef728] Checking autorecoverable hosts done >2012-12-23 15:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-67) [4a6ef728] Autorecovering storage domains is disabled, skipping >2012-12-23 15:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) [4ccf86fe] Checking autorecoverable hosts >2012-12-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) [4ccf86fe] Autorecovering 0 hosts >2012-12-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) [4ccf86fe] Checking autorecoverable hosts done >2012-12-23 15:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-56) [4ccf86fe] Autorecovering storage domains is disabled, skipping >2012-12-23 15:27:17,254 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [714dd661] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:27:17,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [714dd661] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=bec2c1e1-2de3-41fc-8e7a-fbfdee5999e6, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=fe:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=bec2c1e1-2de3-41fc-8e7a-fbfdee5999e6, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x14, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4cc667f2 >2012-12-23 15:27:17,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [714dd661] FINISH, HotUnplugNicVDSCommand, log id: 4cc667f2 >2012-12-23 15:27:38,193 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-47) [281508e0] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:27:38,197 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) [281508e0] MacPoolManager::freeMac(mac = fe:1a:4a:16:88:59) - entered >2012-12-23 15:29:10,414 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-6) [3fe464a6] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:29:10,531 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-6) [53d136c3] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:29:10,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-6) [53d136c3] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=2acbdb7d-74b0-4be1-8175-c393f4a734c4, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=fc:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=2acbdb7d-74b0-4be1-8175-c393f4a734c4, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 28898913 >2012-12-23 15:29:11,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-6) [53d136c3] FINISH, HotPlugNicVDSCommand, log id: 28898913 >2012-12-23 15:29:20,394 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-63) [1e16368b] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 77ca42a4 >2012-12-23 15:29:20,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-63) [1e16368b] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@7fdd5a6c, log id: 77ca42a4 >2012-12-23 15:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Checking autorecoverable hosts >2012-12-23 15:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Autorecovering 0 hosts >2012-12-23 15:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Checking autorecoverable hosts done >2012-12-23 15:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Autorecovering storage domains is disabled, skipping >2012-12-23 15:31:40,106 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-10) [4fe2c6a2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:31:40,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [4fe2c6a2] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=2acbdb7d-74b0-4be1-8175-c393f4a734c4, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=fc:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=2acbdb7d-74b0-4be1-8175-c393f4a734c4, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x15, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 768bd977 >2012-12-23 15:31:40,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [4fe2c6a2] FINISH, HotUnplugNicVDSCommand, log id: 768bd977 >2012-12-23 15:31:45,434 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-10) [a39b012] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:31:45,436 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-10) [a39b012] MacPoolManager::freeMac(mac = fc:1a:4a:16:88:59) - entered >2012-12-23 15:32:16,346 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-3) [14b00230] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:32:16,458 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-3) [1bf9a28f] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:32:16,461 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [1bf9a28f] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=968a92a9-524b-414d-ba9a-a2237d1455df, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:13:17:3d:cd:aa, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=968a92a9-524b-414d-ba9a-a2237d1455df, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 26f20cee >2012-12-23 15:32:16,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-3) [1bf9a28f] FINISH, HotPlugNicVDSCommand, log id: 26f20cee >2012-12-23 15:32:18,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-19) START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 39c1b724 >2012-12-23 15:32:18,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-19) FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5cdeba1b, log id: 39c1b724 >2012-12-23 15:32:33,603 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-34) [5b426f64] DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 15:34:47,493 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [1fc5205c] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:34:47,495 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [1fc5205c] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=968a92a9-524b-414d-ba9a-a2237d1455df, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:13:17:3d:cd:aa, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=968a92a9-524b-414d-ba9a-a2237d1455df, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x16, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 31f1d8a5 >2012-12-23 15:34:47,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [1fc5205c] FINISH, HotUnplugNicVDSCommand, log id: 31f1d8a5 >2012-12-23 15:34:51,753 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-47) [61a5d49f] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:34:51,755 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-47) [61a5d49f] MacPoolManager::freeMac(mac = 00:13:17:3d:cd:aa) - entered >2012-12-23 15:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [650ade11] Checking autorecoverable hosts >2012-12-23 15:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [650ade11] Autorecovering 0 hosts >2012-12-23 15:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [650ade11] Checking autorecoverable hosts done >2012-12-23 15:35:00,005 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [650ade11] Autorecovering storage domains is disabled, skipping >2012-12-23 15:36:42,432 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-11) [1d17ffab] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:36:42,520 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-11) [4ebdd68f] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 15:36:42,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [4ebdd68f] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 128dd831 >2012-12-23 15:36:43,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-11) [4ebdd68f] FINISH, HotPlugNicVDSCommand, log id: 128dd831 >2012-12-23 15:36:48,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-2) [34a38b53] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 61053ccd >2012-12-23 15:36:48,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-2) [34a38b53] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@1edae87e, log id: 61053ccd >2012-12-23 15:37:33,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) [7234eda1] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 645e290e >2012-12-23 15:37:33,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-49) [7234eda1] FINISH, IsValidVDSCommand, return: true, log id: 645e290e >2012-12-23 15:37:33,028 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-49) [7234eda1] START, GetFloppyListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 264fcdc4 >2012-12-23 15:37:33,033 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) [7234eda1] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 2e8d2b5c >2012-12-23 15:37:33,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (pool-3-thread-47) [7234eda1] FINISH, IsValidVDSCommand, return: true, log id: 2e8d2b5c >2012-12-23 15:37:33,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-47) [7234eda1] START, GetIsoListVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 1826411f >2012-12-23 15:37:33,101 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetFloppyListVDSCommand] (pool-3-thread-49) [7234eda1] FINISH, GetFloppyListVDSCommand, return: [win7-64.vfd, win2003-x64-unattended.vfd, win2k8-R2.vfd, win7x64_with_virtio.vfd, win7-32.vfd, win2k3-64-with-virtio.vfd, win2003-32-unattended.vfd, win2000-Pro-unattended.vfd, win2k3-32-with-virtio.vfd, win2k8-32_with_virtio.vfd, virtio-drivers-1.0.0-45801.vfd, win2k3.vfd, winxp.vfd, win2k3x64.vfd, virtio-win-1.4.0.vfd, winXP-Pro-SP2-32-unattended.vfd, virtio-drivers.vfd, virtio-win-1.1.16.vfd, winXP-x64-unattended.vfd, win7-32_with_virtio.vfd, winxp_32_virtio.vfd, virtio-drivers-1.0.0-8.vfd, win2k8-R2_with_virtio.vfd], log id: 264fcdc4 >2012-12-23 15:37:33,105 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-47) [7234eda1] START, HsmGetIsoListVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId=4027fdea-c811-4bf2-b779-25dbdcacbea5), log id: 20a6af1b >2012-12-23 15:37:33,145 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-3-thread-49) [7234eda1] Finished automatic refresh process for Floppy file type with success, for storage domain id 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6. >2012-12-23 15:37:33,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HsmGetIsoListVDSCommand] (pool-3-thread-47) [7234eda1] FINISH, HsmGetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 20a6af1b >2012-12-23 15:37:33,181 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetIsoListVDSCommand] (pool-3-thread-47) [7234eda1] FINISH, GetIsoListVDSCommand, return: [fakeISO01.iso, RHEV-toolsSetup_2.3_327.iso, WindowsXP-sp2-vlk.iso, en_windows_server_2008_r2_standard_enterprise_datacenter_and_web_x64_dvd_x15-59754.iso, RHEV-toolsSetup_2.3_359.iso, Windows2003-r2-std-32-bit.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC2.iso, RHEV-toolsSetup_3.1_9.iso, Windows7-ent.iso, RHEV-toolsSetup_2.3_360-fake.iso, Windows2008-x86.iso, WindowsXP.iso, EnglishWindowsServer2003R2withSP2VLPStandard64bitDISC1.iso, RHEV-toolsSetup_2.3_276.iso, Windows2003-r2-x64-disc2.iso, RHEV-toolsSetup_2.3_395.iso, Windows2008-x64.iso, RHEV-toolsSetup_2.3_298.iso, Windows2008-r2.iso, RHEV-toolsSetup_2.3_317.iso, IT_WINXP_PRO_VL_ISO.iso, RHEV-toolsSetup_3.0_17.iso, RHEV-toolsSetup_2.2_52976.iso, fakeISO1.iso, EnglishWindowsServer2003R2withSP2VLPEnterprise32bitDISC1.iso, en_windows_7_enterprise_x86_dvd_x15-70745.iso, Fedora-17-Alpha-x86_64-DVD.iso, RHS-2.0-20120530.6-RHS-x86_64-DVD1.iso, RHEV-toolsSetup_2.2_46140.iso, en_windows_7_enterprise_x64.iso, en_windows_xp_professional_with_service_pack_3_x86_cd_vl_x14-73974.iso, en_windows_7_enterprise_x64_dvd_x15-70749.iso, Windows2003-r2-x64-disc1.iso, RHEL-6.0-BETA2-20100622.1-Server-x86_64-DVD1.iso, RHEL5.5-Server-20100201.0-x86_64-DVD.iso, RHEV-toolsSetup_2.2_47513.iso, RHEV-toolsSetup_3.0_30.iso, fakeISO02.iso, RHEV-toolsSetup_2.2_52832.iso, RHEV-toolsSetup_3.0_32.iso, rhev-tools-setup.iso, MUI_Windows_server_2003_r2_cd1.iso, RHEV-toolsSetup_2.3_338.iso, rhev-hypervisor-6.1-snap27.el6.iso, Windows2003_r2_VLK.iso], log id: 1826411f >2012-12-23 15:37:33,221 INFO [org.ovirt.engine.core.bll.IsoDomainListSyncronizer] (pool-3-thread-47) [7234eda1] Finished automatic refresh process for ISO file type with success, for storage domain id 7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6. >2012-12-23 15:37:50,092 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [47caba15] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:37:50,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetStatsVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:37:50,095 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-36) [b94e959] vds::refreshVdsStats Failed getVdsStats, vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, error = VDSNetworkException: VDSNetworkException: >2012-12-23 15:37:50,100 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:37:50,109 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-36) [b94e959] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:37:50,185 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: SocketException: Connection reset >2012-12-23 15:37:50,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:37:50,192 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] Irs placed on server null failed. Proceed Failover >2012-12-23 15:37:50,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:37:50,241 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:37:50,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1124e19e >2012-12-23 15:37:50,265 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] spmStart polling started: taskId = bd302562-7bde-4eee-9f17-5d9ef685289d >2012-12-23 15:37:52,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:37:52,120 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-79) [63986237] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:37:54,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:37:54,132 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-85) [4c716d46] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:37:54,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [7c3e7d1a] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:37:54,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [7c3e7d1a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:37:54,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] spmStart polling ended: taskId = bd302562-7bde-4eee-9f17-5d9ef685289d task status = finished >2012-12-23 15:37:54,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:37:54,375 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] spmStart polling ended, spm status: Free >2012-12-23 15:37:54,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bd302562-7bde-4eee-9f17-5d9ef685289d), log id: 202ff4bd >2012-12-23 15:37:54,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] FINISH, HSMClearTaskVDSCommand, log id: 202ff4bd >2012-12-23 15:37:54,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [7c3e7d1a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c6cb4cd, log id: 1124e19e >2012-12-23 15:37:54,400 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-69) [14d21584] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:37:54,469 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:37:56,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:37:56,144 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-91) [4e8142ca] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:37:58,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:37:58,155 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-94) [4e518f73] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:00,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:00,166 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-93) [28a2f6dc] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:02,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:02,176 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-96) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:04,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:04,188 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-84) [6b4d690d] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:04,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [6668e99] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:38:04,542 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [6668e99] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:38:04,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4155ebf1 >2012-12-23 15:38:04,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] spmStart polling started: taskId = 7ea1eba8-2d9a-4f85-8b10-9ddf3813d4ce >2012-12-23 15:38:06,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:06,199 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-78) [2260099b] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:08,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:08,211 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-4) [28f88b51] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:10,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:10,221 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-16) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:12,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:12,232 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-89) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:14,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:14,243 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-19) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:14,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [6668e99] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:38:14,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [6668e99] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:14,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] spmStart polling ended: taskId = 7ea1eba8-2d9a-4f85-8b10-9ddf3813d4ce task status = finished >2012-12-23 15:38:14,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:14,860 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] spmStart polling ended, spm status: Free >2012-12-23 15:38:14,861 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-71) [6668e99] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7ea1eba8-2d9a-4f85-8b10-9ddf3813d4ce), log id: 12c1b773 >2012-12-23 15:38:14,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-71) [6668e99] FINISH, HSMClearTaskVDSCommand, log id: 12c1b773 >2012-12-23 15:38:14,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [6668e99] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@597b92ec, log id: 4155ebf1 >2012-12-23 15:38:14,886 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-71) [3feaf1d9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:38:14,914 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:38:16,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:16,254 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-17) [32e1aaf9] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:18,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:18,265 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-29) [337c7b8f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:20,275 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [257bff21] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:20,275 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-22) [257bff21] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:22,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:22,288 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-97) [236a4c61] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:24,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:24,299 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-18) [1a8d41e7] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:24,940 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:38:24,968 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:38:24,969 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2166e0e7 >2012-12-23 15:38:24,991 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) spmStart polling started: taskId = 760bc538-d14f-42ab-be8c-18c7b55c13e9 >2012-12-23 15:38:26,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:26,309 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-35) [3adaf394] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:28,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:28,325 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-99) [5cbcd232] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:30,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:30,335 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-34) [5b426f64] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:32,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:32,346 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-40) [6b7660a2] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:34,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:34,357 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-30) ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:35,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:38:35,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:35,229 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) spmStart polling ended: taskId = 760bc538-d14f-42ab-be8c-18c7b55c13e9 task status = finished >2012-12-23 15:38:35,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:35,249 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) spmStart polling ended, spm status: Free >2012-12-23 15:38:35,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=760bc538-d14f-42ab-be8c-18c7b55c13e9), log id: 7eb4510 >2012-12-23 15:38:35,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) FINISH, HSMClearTaskVDSCommand, log id: 7eb4510 >2012-12-23 15:38:35,269 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6703217f, log id: 2166e0e7 >2012-12-23 15:38:35,272 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-8) [7e8c4dae] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:38:35,298 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [7e8c4dae] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:38:36,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:36,373 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-12) [5e62365e] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:38,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:38,384 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-52) [650ade11] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 1ea924d8-49a9-11e2-bbf4-001122334455 : orchid-vds1, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 15:38:40,394 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:40,394 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-81) [49f3c5ee] VDS::handleNetworkException Server failed to respond, vds_id = 1ea924d8-49a9-11e2-bbf4-001122334455, vds_name = orchid-vds1, error = VDSNetworkException: >2012-12-23 15:38:40,433 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-3-thread-47) [49f3c5ee] ResourceManager::vdsNotResponding entered for Host 1ea924d8-49a9-11e2-bbf4-001122334455, orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 15:38:40,533 WARN [org.ovirt.engine.core.bll.VdsNotRespondingTreatmentCommand] (pool-3-thread-47) [7015d02a] CanDoAction of action VdsNotRespondingTreatment failed. Reasons:VDS_FENCING_DISABLED >2012-12-23 15:38:42,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:44,630 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:45,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:38:45,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:38:45,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5153a7b3 >2012-12-23 15:38:45,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) spmStart polling started: taskId = d4bde2fd-431d-47da-bd07-f32e2aafc324 >2012-12-23 15:38:46,704 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:49,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:51,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:53,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:55,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:55,614 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:38:55,614 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:55,614 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) spmStart polling ended: taskId = d4bde2fd-431d-47da-bd07-f32e2aafc324 task status = finished >2012-12-23 15:38:55,614 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:38:55,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) spmStart polling ended, spm status: Free >2012-12-23 15:38:55,635 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d4bde2fd-431d-47da-bd07-f32e2aafc324), log id: 3f280841 >2012-12-23 15:38:55,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) FINISH, HSMClearTaskVDSCommand, log id: 3f280841 >2012-12-23 15:38:55,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5d3603cb, log id: 5153a7b3 >2012-12-23 15:38:55,657 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-83) [533343c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:38:55,695 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [533343c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:38:57,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:38:59,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:01,983 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [3c2192c2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:04,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:05,722 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:39:05,731 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [63986237] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:39:05,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74896af4 >2012-12-23 15:39:05,755 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] spmStart polling started: taskId = f90587e2-3006-4398-8637-19a2e8e4c14f >2012-12-23 15:39:06,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:08,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [76b8981b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:10,541 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:12,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:14,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:15,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [63986237] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:39:15,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [63986237] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:15,992 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] spmStart polling ended: taskId = f90587e2-3006-4398-8637-19a2e8e4c14f task status = finished >2012-12-23 15:39:15,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:16,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] spmStart polling ended, spm status: Free >2012-12-23 15:39:16,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) [63986237] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f90587e2-3006-4398-8637-19a2e8e4c14f), log id: 23b84f58 >2012-12-23 15:39:16,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) [63986237] FINISH, HSMClearTaskVDSCommand, log id: 23b84f58 >2012-12-23 15:39:16,032 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [63986237] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@19612cba, log id: 74896af4 >2012-12-23 15:39:16,034 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-79) [3abf745a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:39:16,075 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:39:16,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:19,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:21,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:23,338 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [4179f854] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:25,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:39:26,101 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [637c0ca0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:39:26,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [637c0ca0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:39:26,127 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3601d47d >2012-12-23 15:39:26,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] spmStart polling started: taskId = e4ecbacf-bd7c-4aca-b61c-bd4532b6ee33 >2012-12-23 15:39:27,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:29,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:31,530 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [d6e0e9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:33,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:35,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:36,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [637c0ca0] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:39:36,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-15) [637c0ca0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:36,569 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] spmStart polling ended: taskId = e4ecbacf-bd7c-4aca-b61c-bd4532b6ee33 task status = finished >2012-12-23 15:39:36,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:36,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] spmStart polling ended, spm status: Free >2012-12-23 15:39:36,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e4ecbacf-bd7c-4aca-b61c-bd4532b6ee33), log id: 68fe1765 >2012-12-23 15:39:36,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] FINISH, HSMClearTaskVDSCommand, log id: 68fe1765 >2012-12-23 15:39:36,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-15) [637c0ca0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1b21dbd, log id: 3601d47d >2012-12-23 15:39:36,622 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-15) [54be6429] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:39:37,340 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:39:37,674 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:39,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:41,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:44,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:46,332 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:47,367 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [7e8c4dae] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:39:47,403 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [7e8c4dae] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:39:47,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1ad7e2a5 >2012-12-23 15:39:47,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] spmStart polling started: taskId = fb738870-d00e-4e43-b71b-eb9e9b278d66 >2012-12-23 15:39:48,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:50,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:53,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:55,630 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:57,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [7e8c4dae] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:39:57,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [7e8c4dae] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:57,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] spmStart polling ended: taskId = fb738870-d00e-4e43-b71b-eb9e9b278d66 task status = finished >2012-12-23 15:39:57,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:39:57,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:39:57,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] spmStart polling ended, spm status: Free >2012-12-23 15:39:57,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=fb738870-d00e-4e43-b71b-eb9e9b278d66), log id: 4221ef5f >2012-12-23 15:39:57,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] FINISH, HSMClearTaskVDSCommand, log id: 4221ef5f >2012-12-23 15:39:57,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [7e8c4dae] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f0edf35, log id: 1ad7e2a5 >2012-12-23 15:39:57,758 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-8) [9602081] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:39:57,855 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:39:59,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [1e16368b] Checking autorecoverable hosts >2012-12-23 15:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [1e16368b] Autorecovering 0 hosts >2012-12-23 15:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [1e16368b] Checking autorecoverable hosts done >2012-12-23 15:40:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-63) [1e16368b] Autorecovering storage domains is disabled, skipping >2012-12-23 15:40:01,866 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:04,307 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:06,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:07,883 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:40:07,895 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [6ec63335] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:40:07,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 49b3ac8d >2012-12-23 15:40:07,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] spmStart polling started: taskId = 07dc8c0a-e121-451b-996e-e1450436caec >2012-12-23 15:40:08,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:10,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:12,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:14,602 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:16,679 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:18,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [6ec63335] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:40:18,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [6ec63335] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:18,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] spmStart polling ended: taskId = 07dc8c0a-e121-451b-996e-e1450436caec task status = finished >2012-12-23 15:40:18,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:18,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] spmStart polling ended, spm status: Free >2012-12-23 15:40:18,189 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=07dc8c0a-e121-451b-996e-e1450436caec), log id: e5db7c5 >2012-12-23 15:40:18,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] FINISH, HSMClearTaskVDSCommand, log id: e5db7c5 >2012-12-23 15:40:18,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [6ec63335] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2acbede1, log id: 49b3ac8d >2012-12-23 15:40:18,210 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [326e64ba] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:40:18,295 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [326e64ba] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:40:19,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:21,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [76b8981b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:24,394 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:26,532 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:28,322 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:40:28,769 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [202ccef9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:40:28,770 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 75d8ee65 >2012-12-23 15:40:28,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] spmStart polling started: taskId = 1a06b6f7-a2ed-4953-bae5-e868e0807a9d >2012-12-23 15:40:30,779 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:33,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:35,696 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:38,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [202ccef9] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:40:38,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [202ccef9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:38,043 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] spmStart polling ended: taskId = 1a06b6f7-a2ed-4953-bae5-e868e0807a9d task status = finished >2012-12-23 15:40:38,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:38,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] spmStart polling ended, spm status: Free >2012-12-23 15:40:38,063 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1a06b6f7-a2ed-4953-bae5-e868e0807a9d), log id: 66be2303 >2012-12-23 15:40:38,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] FINISH, HSMClearTaskVDSCommand, log id: 66be2303 >2012-12-23 15:40:38,082 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [202ccef9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4ceccea7, log id: 75d8ee65 >2012-12-23 15:40:38,086 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-61) [4ef35d65] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:40:38,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [4179f854] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:38,975 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [4ef35d65] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:40:40,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:43,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:45,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:47,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:49,001 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [257bff21] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:40:49,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [257bff21] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:40:49,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4df17d9b >2012-12-23 15:40:49,045 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] spmStart polling started: taskId = dc4d8ff8-ae37-4247-aacb-a0a5fa011c9d >2012-12-23 15:40:49,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:40:51,559 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:53,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [2d9a7b90] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:55,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:57,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:40:59,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [257bff21] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:40:59,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-22) [257bff21] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:59,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] spmStart polling ended: taskId = dc4d8ff8-ae37-4247-aacb-a0a5fa011c9d task status = finished >2012-12-23 15:40:59,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:40:59,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] spmStart polling ended, spm status: Free >2012-12-23 15:40:59,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-22) [257bff21] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=dc4d8ff8-ae37-4247-aacb-a0a5fa011c9d), log id: 3f4c3185 >2012-12-23 15:40:59,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-22) [257bff21] FINISH, HSMClearTaskVDSCommand, log id: 3f4c3185 >2012-12-23 15:40:59,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-22) [257bff21] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2347333a, log id: 4df17d9b >2012-12-23 15:40:59,323 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-22) [177436ee] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:40:59,404 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:40:59,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:02,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:04,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7cbeff68] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:06,308 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:08,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:09,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [5d21c479] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:41:09,471 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [5d21c479] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:41:09,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5f21bb11 >2012-12-23 15:41:09,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] spmStart polling started: taskId = f572ae22-b908-4be0-a826-281b0c998613 >2012-12-23 15:41:10,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:12,794 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:14,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:16,949 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:19,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [5d21c479] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:41:19,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [5d21c479] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:19,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] spmStart polling ended: taskId = f572ae22-b908-4be0-a826-281b0c998613 task status = finished >2012-12-23 15:41:19,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:19,771 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:41:19,781 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] spmStart polling ended, spm status: Free >2012-12-23 15:41:19,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f572ae22-b908-4be0-a826-281b0c998613), log id: 8c6862d >2012-12-23 15:41:19,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] FINISH, HSMClearTaskVDSCommand, log id: 8c6862d >2012-12-23 15:41:19,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [5d21c479] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3338dbce, log id: 5f21bb11 >2012-12-23 15:41:19,805 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-54) [59e6cba7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:41:19,836 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [59e6cba7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:41:21,810 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:24,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:26,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [198dadd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:28,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:29,863 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [3c2192c2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:41:29,873 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [3c2192c2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:41:29,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 44aa5707 >2012-12-23 15:41:29,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] spmStart polling started: taskId = 07128dc8-cb24-44fa-b188-361396ea1916 >2012-12-23 15:41:33,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:35,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) [66e5b3d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:37,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:39,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [3c2192c2] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:41:39,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [3c2192c2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:39,117 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] spmStart polling ended: taskId = 07128dc8-cb24-44fa-b188-361396ea1916 task status = finished >2012-12-23 15:41:39,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:39,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] spmStart polling ended, spm status: Free >2012-12-23 15:41:39,137 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=07128dc8-cb24-44fa-b188-361396ea1916), log id: 4b290441 >2012-12-23 15:41:39,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] FINISH, HSMClearTaskVDSCommand, log id: 4b290441 >2012-12-23 15:41:39,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [3c2192c2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@71d66df3, log id: 44aa5707 >2012-12-23 15:41:39,158 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [34cca6e8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:41:39,204 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:41:39,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:41,540 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:44,062 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:46,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:48,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:49,230 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:41:49,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [3c487466] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:41:49,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7d253186 >2012-12-23 15:41:49,262 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] spmStart polling started: taskId = 76b29dfc-64a5-4db0-af49-2d97b79202c4 >2012-12-23 15:41:50,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:52,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [4ef35d65] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:54,282 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:56,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:58,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:41:59,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [3c487466] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:41:59,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [3c487466] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:59,528 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] spmStart polling ended: taskId = 76b29dfc-64a5-4db0-af49-2d97b79202c4 task status = finished >2012-12-23 15:41:59,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:41:59,551 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] spmStart polling ended, spm status: Free >2012-12-23 15:41:59,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [3c487466] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=76b29dfc-64a5-4db0-af49-2d97b79202c4), log id: 496cddb2 >2012-12-23 15:41:59,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [3c487466] FINISH, HSMClearTaskVDSCommand, log id: 496cddb2 >2012-12-23 15:41:59,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [3c487466] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@a4ef6c7, log id: 7d253186 >2012-12-23 15:41:59,573 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [462b881a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:41:59,641 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:42:00,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [d6e0e9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:02,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:04,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:06,642 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:09,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:09,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:42:09,682 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [52e3b2be] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:42:09,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4a3ad71d >2012-12-23 15:42:09,706 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] spmStart polling started: taskId = 94c4ad4e-018c-4e77-954b-707f415f2e0b >2012-12-23 15:42:11,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:13,322 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:15,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:17,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7cbeff68] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:19,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:42:19,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [52e3b2be] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:42:19,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [52e3b2be] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:42:19,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] spmStart polling ended: taskId = 94c4ad4e-018c-4e77-954b-707f415f2e0b task status = finished >2012-12-23 15:42:19,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:42:19,996 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] spmStart polling ended, spm status: Free >2012-12-23 15:42:19,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=94c4ad4e-018c-4e77-954b-707f415f2e0b), log id: 377ab1b6 >2012-12-23 15:42:20,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] FINISH, HSMClearTaskVDSCommand, log id: 377ab1b6 >2012-12-23 15:42:20,017 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [52e3b2be] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5829402e, log id: 4a3ad71d >2012-12-23 15:42:20,019 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [7c34b939] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:42:20,077 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [7c34b939] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:42:21,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:24,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:26,038 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:28,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:30,103 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:42:30,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [327f6ae5] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:42:30,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 212e3e17 >2012-12-23 15:42:30,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] spmStart polling started: taskId = 18c198fb-7fc8-465d-9348-f17ace27ba42 >2012-12-23 15:42:30,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:32,226 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:34,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:36,312 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:38,441 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [533343c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:40,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [327f6ae5] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:42:40,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [327f6ae5] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:42:40,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] spmStart polling ended: taskId = 18c198fb-7fc8-465d-9348-f17ace27ba42 task status = finished >2012-12-23 15:42:40,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:42:40,379 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] spmStart polling ended, spm status: Free >2012-12-23 15:42:40,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=18c198fb-7fc8-465d-9348-f17ace27ba42), log id: 3842e3f3 >2012-12-23 15:42:40,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] FINISH, HSMClearTaskVDSCommand, log id: 3842e3f3 >2012-12-23 15:42:40,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [327f6ae5] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f838360, log id: 212e3e17 >2012-12-23 15:42:40,401 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [63262bfe] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:42:40,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:40,498 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [63262bfe] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:42:42,550 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:44,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:46,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:49,003 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:50,533 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:42:50,588 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [4e8142ca] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:42:50,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 17853834 >2012-12-23 15:42:50,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] spmStart polling started: taskId = 4362dcd1-5e25-4168-b105-ba28390db6fa >2012-12-23 15:42:51,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:53,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:55,294 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:57,351 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:42:59,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:00,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [4e8142ca] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:43:00,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [4e8142ca] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:00,864 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] spmStart polling ended: taskId = 4362dcd1-5e25-4168-b105-ba28390db6fa task status = finished >2012-12-23 15:43:00,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:00,883 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] spmStart polling ended, spm status: Free >2012-12-23 15:43:00,885 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4362dcd1-5e25-4168-b105-ba28390db6fa), log id: 2ad9166e >2012-12-23 15:43:00,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] FINISH, HSMClearTaskVDSCommand, log id: 2ad9166e >2012-12-23 15:43:00,904 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [4e8142ca] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@124fa5bc, log id: 17853834 >2012-12-23 15:43:00,906 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-91) [2b09e308] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:43:00,959 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [2b09e308] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:43:01,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:03,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:06,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:08,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:10,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:10,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:43:11,011 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [32e1aaf9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:43:11,013 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 47f7dc12 >2012-12-23 15:43:11,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] spmStart polling started: taskId = e79d22b3-a678-4a1a-ba44-da36443fea91 >2012-12-23 15:43:12,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:14,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:16,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:18,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:20,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:22,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [32e1aaf9] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:43:22,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [32e1aaf9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:22,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] spmStart polling ended: taskId = e79d22b3-a678-4a1a-ba44-da36443fea91 task status = finished >2012-12-23 15:43:22,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:22,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] spmStart polling ended, spm status: Free >2012-12-23 15:43:22,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e79d22b3-a678-4a1a-ba44-da36443fea91), log id: 26b76636 >2012-12-23 15:43:22,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] FINISH, HSMClearTaskVDSCommand, log id: 26b76636 >2012-12-23 15:43:22,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [32e1aaf9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@52977715, log id: 47f7dc12 >2012-12-23 15:43:22,363 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [560b2e0f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:43:22,391 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:43:22,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:24,833 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:26,876 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:29,520 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:31,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:32,419 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [7c34b939] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:43:32,480 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [7c34b939] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:43:32,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1546364d >2012-12-23 15:43:32,504 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] spmStart polling started: taskId = cac07dac-b641-4ed1-ba99-5003ca23e3f9 >2012-12-23 15:43:34,033 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:36,092 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:38,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:40,626 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:42,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:42,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [7c34b939] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:43:42,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [7c34b939] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:42,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] spmStart polling ended: taskId = cac07dac-b641-4ed1-ba99-5003ca23e3f9 task status = finished >2012-12-23 15:43:42,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:43:42,764 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] spmStart polling ended, spm status: Free >2012-12-23 15:43:42,766 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=cac07dac-b641-4ed1-ba99-5003ca23e3f9), log id: 68fe414d >2012-12-23 15:43:42,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] FINISH, HSMClearTaskVDSCommand, log id: 68fe414d >2012-12-23 15:43:42,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [7c34b939] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@c715c15, log id: 1546364d >2012-12-23 15:43:42,786 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [66546d14] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:43:42,826 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [66546d14] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:43:44,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:43:52,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [198dadd] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:43:52,864 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [198dadd] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:43:52,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5f46becb >2012-12-23 15:43:52,890 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] spmStart polling started: taskId = aea16f64-16ea-4242-8005-521dd6cc97a9 >2012-12-23 15:44:04,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [198dadd] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:44:04,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-72) [198dadd] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:04,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] spmStart polling ended: taskId = aea16f64-16ea-4242-8005-521dd6cc97a9 task status = finished >2012-12-23 15:44:04,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:04,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] spmStart polling ended, spm status: Free >2012-12-23 15:44:04,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) [198dadd] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=aea16f64-16ea-4242-8005-521dd6cc97a9), log id: 45d233c8 >2012-12-23 15:44:04,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-72) [198dadd] FINISH, HSMClearTaskVDSCommand, log id: 45d233c8 >2012-12-23 15:44:04,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-72) [198dadd] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6b45b347, log id: 5f46becb >2012-12-23 15:44:04,204 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-72) [2cfd3156] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:44:04,264 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:44:14,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [76b8981b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:44:14,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [76b8981b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:44:14,328 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 14a109d2 >2012-12-23 15:44:14,351 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] spmStart polling started: taskId = ce2dab03-0158-4591-bf89-abd1e8c5f2ba >2012-12-23 15:44:23,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [76b8981b] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:44:23,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [76b8981b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:23,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] spmStart polling ended: taskId = ce2dab03-0158-4591-bf89-abd1e8c5f2ba task status = finished >2012-12-23 15:44:23,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:23,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] spmStart polling ended, spm status: Free >2012-12-23 15:44:23,613 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ce2dab03-0158-4591-bf89-abd1e8c5f2ba), log id: 11d40ef3 >2012-12-23 15:44:23,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] FINISH, HSMClearTaskVDSCommand, log id: 11d40ef3 >2012-12-23 15:44:23,631 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [76b8981b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@79217ca9, log id: 14a109d2 >2012-12-23 15:44:23,635 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-26) [57f7960] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:44:23,689 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [57f7960] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:44:33,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [4179f854] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:44:33,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [4179f854] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:44:33,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4d4494f6 >2012-12-23 15:44:33,770 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] spmStart polling started: taskId = 7c213936-d3cc-4dd4-bd0b-a911f12a9971 >2012-12-23 15:44:44,025 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) [4179f854] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:44:44,025 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-77) [4179f854] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:44,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] spmStart polling ended: taskId = 7c213936-d3cc-4dd4-bd0b-a911f12a9971 task status = finished >2012-12-23 15:44:44,025 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:44:44,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] spmStart polling ended, spm status: Free >2012-12-23 15:44:44,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-77) [4179f854] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7c213936-d3cc-4dd4-bd0b-a911f12a9971), log id: 6d1ec55f >2012-12-23 15:44:44,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-77) [4179f854] FINISH, HSMClearTaskVDSCommand, log id: 6d1ec55f >2012-12-23 15:44:44,147 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-77) [4179f854] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2e73cecc, log id: 4d4494f6 >2012-12-23 15:44:44,149 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-77) [350dcae7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:44:44,265 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:44:54,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [5db9c54d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:44:54,309 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [5db9c54d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:44:54,310 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5e083491 >2012-12-23 15:44:54,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] spmStart polling started: taskId = 314f7f1a-4d1d-4f3b-9f25-1e132bfcf216 >2012-12-23 15:45:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [560b2e0f] Checking autorecoverable hosts >2012-12-23 15:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [560b2e0f] Autorecovering 0 hosts >2012-12-23 15:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [560b2e0f] Checking autorecoverable hosts done >2012-12-23 15:45:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-17) [560b2e0f] Autorecovering storage domains is disabled, skipping >2012-12-23 15:45:05,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [5db9c54d] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:45:05,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [5db9c54d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:05,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] spmStart polling ended: taskId = 314f7f1a-4d1d-4f3b-9f25-1e132bfcf216 task status = finished >2012-12-23 15:45:05,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:05,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] spmStart polling ended, spm status: Free >2012-12-23 15:45:05,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=314f7f1a-4d1d-4f3b-9f25-1e132bfcf216), log id: 3e406b21 >2012-12-23 15:45:05,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] FINISH, HSMClearTaskVDSCommand, log id: 3e406b21 >2012-12-23 15:45:05,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [5db9c54d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@77396374, log id: 5e083491 >2012-12-23 15:45:05,658 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-20) [58b091d2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:45:05,735 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:45:15,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:45:15,796 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [650ade11] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:45:15,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3226daf3 >2012-12-23 15:45:15,821 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] spmStart polling started: taskId = 51302489-5629-4fcd-bc2a-ef35199d6a52 >2012-12-23 15:45:26,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [650ade11] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:45:26,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [650ade11] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:26,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] spmStart polling ended: taskId = 51302489-5629-4fcd-bc2a-ef35199d6a52 task status = finished >2012-12-23 15:45:26,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:26,093 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] spmStart polling ended, spm status: Free >2012-12-23 15:45:26,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [650ade11] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=51302489-5629-4fcd-bc2a-ef35199d6a52), log id: 1e3952b4 >2012-12-23 15:45:26,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [650ade11] FINISH, HSMClearTaskVDSCommand, log id: 1e3952b4 >2012-12-23 15:45:26,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [650ade11] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4564b6ec, log id: 3226daf3 >2012-12-23 15:45:26,116 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-52) [5725638b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:45:26,170 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [5725638b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:45:36,210 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:45:36,299 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [7234eda1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:45:36,300 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 44b3006b >2012-12-23 15:45:36,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] spmStart polling started: taskId = 6b369b8a-529f-4e55-bdf0-d9a6736b1822 >2012-12-23 15:45:46,545 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [7234eda1] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:45:46,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [7234eda1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:46,546 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] spmStart polling ended: taskId = 6b369b8a-529f-4e55-bdf0-d9a6736b1822 task status = finished >2012-12-23 15:45:46,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:45:46,564 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] spmStart polling ended, spm status: Free >2012-12-23 15:45:46,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6b369b8a-529f-4e55-bdf0-d9a6736b1822), log id: 41b6af20 >2012-12-23 15:45:46,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] FINISH, HSMClearTaskVDSCommand, log id: 41b6af20 >2012-12-23 15:45:46,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [7234eda1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@40a37f94, log id: 44b3006b >2012-12-23 15:45:46,590 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:45:46,961 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:45:56,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [66e5b3d4] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:45:57,390 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [66e5b3d4] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:45:57,392 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3c5b0472 >2012-12-23 15:45:57,416 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] spmStart polling started: taskId = 709fbbab-8c47-4986-a12c-393f76be7477 >2012-12-23 15:46:06,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [66e5b3d4] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:46:06,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [66e5b3d4] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:06,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] spmStart polling ended: taskId = 709fbbab-8c47-4986-a12c-393f76be7477 task status = finished >2012-12-23 15:46:06,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:06,629 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] spmStart polling ended, spm status: Free >2012-12-23 15:46:06,630 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=709fbbab-8c47-4986-a12c-393f76be7477), log id: 65e98359 >2012-12-23 15:46:06,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] FINISH, HSMClearTaskVDSCommand, log id: 65e98359 >2012-12-23 15:46:06,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [66e5b3d4] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@45ae7c54, log id: 3c5b0472 >2012-12-23 15:46:06,651 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-59) [42649289] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:46:07,366 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [42649289] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:46:17,395 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:46:17,431 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [2260099b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:46:17,433 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7f8ac5f9 >2012-12-23 15:46:17,457 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] spmStart polling started: taskId = 7746d6f0-46d1-4866-9a6f-c01d95286cd5 >2012-12-23 15:46:27,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) [2260099b] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:46:27,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-78) [2260099b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:27,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] spmStart polling ended: taskId = 7746d6f0-46d1-4866-9a6f-c01d95286cd5 task status = finished >2012-12-23 15:46:27,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:27,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] spmStart polling ended, spm status: Free >2012-12-23 15:46:27,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-78) [2260099b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7746d6f0-46d1-4866-9a6f-c01d95286cd5), log id: 6a80e46c >2012-12-23 15:46:27,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-78) [2260099b] FINISH, HSMClearTaskVDSCommand, log id: 6a80e46c >2012-12-23 15:46:27,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-78) [2260099b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3414a514, log id: 7f8ac5f9 >2012-12-23 15:46:27,752 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-78) [3761dec2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:46:27,829 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:46:37,855 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [d6e0e9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:46:37,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [d6e0e9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:46:37,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6b8471ec >2012-12-23 15:46:37,893 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] spmStart polling started: taskId = c18e28e0-0e79-4fcf-9eb2-a88519d3ac81 >2012-12-23 15:46:46,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 15:46:47,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [d6e0e9] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:46:47,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [d6e0e9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:47,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] spmStart polling ended: taskId = c18e28e0-0e79-4fcf-9eb2-a88519d3ac81 task status = finished >2012-12-23 15:46:47,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:46:47,122 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] spmStart polling ended, spm status: Free >2012-12-23 15:46:47,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c18e28e0-0e79-4fcf-9eb2-a88519d3ac81), log id: 6cb932bc >2012-12-23 15:46:47,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] FINISH, HSMClearTaskVDSCommand, log id: 6cb932bc >2012-12-23 15:46:47,142 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [d6e0e9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@72b20c67, log id: 6b8471ec >2012-12-23 15:46:47,145 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [74c7905] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:46:47,195 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [74c7905] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:46:48,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:46:51,034 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:46:53,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:46:55,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:46:57,220 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:46:57,232 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7cbeff68] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:46:57,261 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7cbeff68] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:46:57,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 47fec1ee >2012-12-23 15:46:57,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] spmStart polling started: taskId = b785d68a-715a-410a-b263-1739203b719b >2012-12-23 15:46:59,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:01,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:03,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:05,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:07,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:07,577 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [7cbeff68] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:47:07,578 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [7cbeff68] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:07,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] spmStart polling ended: taskId = b785d68a-715a-410a-b263-1739203b719b task status = finished >2012-12-23 15:47:07,578 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:07,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] spmStart polling ended, spm status: Free >2012-12-23 15:47:07,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b785d68a-715a-410a-b263-1739203b719b), log id: 31e3bcd1 >2012-12-23 15:47:07,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] FINISH, HSMClearTaskVDSCommand, log id: 31e3bcd1 >2012-12-23 15:47:07,615 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7cbeff68] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5e8156ed, log id: 47fec1ee >2012-12-23 15:47:07,617 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-28) [7d721213] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:47:07,676 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:47:09,568 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:11,619 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:14,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:16,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:17,709 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [533343c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:47:17,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [533343c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:47:17,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 334b1f92 >2012-12-23 15:47:17,765 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] spmStart polling started: taskId = 1c75abc1-17e8-4a45-ae54-175824a51f1b >2012-12-23 15:47:19,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [63262bfe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:21,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:23,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:25,399 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:27,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:28,767 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [533343c] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:47:28,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [533343c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:28,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] spmStart polling ended: taskId = 1c75abc1-17e8-4a45-ae54-175824a51f1b task status = finished >2012-12-23 15:47:28,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:28,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] spmStart polling ended, spm status: Free >2012-12-23 15:47:28,789 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) [533343c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1c75abc1-17e8-4a45-ae54-175824a51f1b), log id: 239fb75f >2012-12-23 15:47:28,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) [533343c] FINISH, HSMClearTaskVDSCommand, log id: 239fb75f >2012-12-23 15:47:28,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [533343c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4abfd03e, log id: 334b1f92 >2012-12-23 15:47:28,811 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-83) [7700bcc8] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:47:28,877 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:47:29,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:31,666 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:34,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:36,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:38,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:38,905 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [57f7960] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:47:39,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [57f7960] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:47:39,299 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: ce9b189 >2012-12-23 15:47:39,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] spmStart polling started: taskId = c98ec7b0-8a40-4135-a917-1747c1bd1214 >2012-12-23 15:47:40,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:42,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:44,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:46,671 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:48,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [57f7960] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:47:48,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-26) [57f7960] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:48,571 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] spmStart polling ended: taskId = c98ec7b0-8a40-4135-a917-1747c1bd1214 task status = finished >2012-12-23 15:47:48,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:47:48,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] spmStart polling ended, spm status: Free >2012-12-23 15:47:48,591 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) [57f7960] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c98ec7b0-8a40-4135-a917-1747c1bd1214), log id: 5aabb7f4 >2012-12-23 15:47:48,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-26) [57f7960] FINISH, HSMClearTaskVDSCommand, log id: 5aabb7f4 >2012-12-23 15:47:48,610 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-26) [57f7960] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3fba22ad, log id: ce9b189 >2012-12-23 15:47:48,612 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-26) [553aac8a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:47:48,650 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:47:49,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:51,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:53,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:55,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:57,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:47:58,677 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [2d9a7b90] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:47:58,693 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [2d9a7b90] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:47:58,695 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 560bacac >2012-12-23 15:47:58,717 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] spmStart polling started: taskId = 218e828c-cdc1-4026-9b2e-6e3ad4c73af8 >2012-12-23 15:47:59,334 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:01,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:04,050 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:06,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:48:08,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:09,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [2d9a7b90] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:48:09,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-10) [2d9a7b90] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:48:09,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] spmStart polling ended: taskId = 218e828c-cdc1-4026-9b2e-6e3ad4c73af8 task status = finished >2012-12-23 15:48:09,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:48:09,993 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] spmStart polling ended, spm status: Free >2012-12-23 15:48:09,995 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=218e828c-cdc1-4026-9b2e-6e3ad4c73af8), log id: 12e3d73e >2012-12-23 15:48:10,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] FINISH, HSMClearTaskVDSCommand, log id: 12e3d73e >2012-12-23 15:48:10,015 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-10) [2d9a7b90] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c483122, log id: 560bacac >2012-12-23 15:48:10,019 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-10) [3791c5e4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:48:10,102 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:48:10,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:12,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:14,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:16,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:19,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:20,127 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:48:20,205 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [773f71e7] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:48:20,208 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 12b4e4c1 >2012-12-23 15:48:20,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] spmStart polling started: taskId = 8428d084-75c1-4ea4-addd-38162f32ba92 >2012-12-23 15:48:21,307 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:26,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:36,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [773f71e7] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:48:36,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [773f71e7] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:48:36,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] spmStart polling ended: taskId = 8428d084-75c1-4ea4-addd-38162f32ba92 task status = finished >2012-12-23 15:48:36,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:48:36,882 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] spmStart polling ended, spm status: Free >2012-12-23 15:48:36,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8428d084-75c1-4ea4-addd-38162f32ba92), log id: 1f473b84 >2012-12-23 15:48:36,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] FINISH, HSMClearTaskVDSCommand, log id: 1f473b84 >2012-12-23 15:48:36,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [773f71e7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7d946726, log id: 12b4e4c1 >2012-12-23 15:48:36,905 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-98) [1a003033] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:48:48,871 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:51,251 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:48:53,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:55,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:57,767 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [326e64ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:48:59,803 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:01,320 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:49:01,827 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [4c716d46] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:49:01,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 44d67aa1 >2012-12-23 15:49:01,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:01,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] spmStart polling started: taskId = ecca2b98-3395-460f-a34d-c54043e04d7c >2012-12-23 15:49:03,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:05,956 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:08,000 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:10,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:11,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [4c716d46] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:49:11,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [4c716d46] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:11,144 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] spmStart polling ended: taskId = ecca2b98-3395-460f-a34d-c54043e04d7c task status = finished >2012-12-23 15:49:11,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:11,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] spmStart polling ended, spm status: Free >2012-12-23 15:49:11,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ecca2b98-3395-460f-a34d-c54043e04d7c), log id: 6693c8b4 >2012-12-23 15:49:11,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] FINISH, HSMClearTaskVDSCommand, log id: 6693c8b4 >2012-12-23 15:49:11,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [4c716d46] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@705dd608, log id: 44d67aa1 >2012-12-23 15:49:11,186 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [208ee0da] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:49:11,235 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [208ee0da] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:49:15,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:17,678 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:19,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:21,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:49:21,294 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [3feaf1d9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:49:21,295 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 31885e3a >2012-12-23 15:49:21,322 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] spmStart polling started: taskId = ea52cdc1-6ab7-42cf-b233-17c2226ec3f0 >2012-12-23 15:49:22,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:24,213 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:26,276 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:28,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:30,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:31,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [3feaf1d9] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:49:31,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-71) [3feaf1d9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:31,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] spmStart polling ended: taskId = ea52cdc1-6ab7-42cf-b233-17c2226ec3f0 task status = finished >2012-12-23 15:49:31,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:31,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] spmStart polling ended, spm status: Free >2012-12-23 15:49:31,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ea52cdc1-6ab7-42cf-b233-17c2226ec3f0), log id: 6a792907 >2012-12-23 15:49:31,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] FINISH, HSMClearTaskVDSCommand, log id: 6a792907 >2012-12-23 15:49:31,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-71) [3feaf1d9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3874c12d, log id: 31885e3a >2012-12-23 15:49:31,693 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-71) [79368e4f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:49:31,758 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:49:32,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:34,715 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:36,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:38,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:40,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:41,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:49:41,800 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [6b7660a2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:49:41,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 33b1bac5 >2012-12-23 15:49:41,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] spmStart polling started: taskId = c02de4c1-c40c-4f6b-9b40-80c20e21e98b >2012-12-23 15:49:43,005 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:45,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:47,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:49,685 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:51,731 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:53,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [6b7660a2] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:49:53,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-40) [6b7660a2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:53,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] spmStart polling ended: taskId = c02de4c1-c40c-4f6b-9b40-80c20e21e98b task status = finished >2012-12-23 15:49:53,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:49:53,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] spmStart polling ended, spm status: Free >2012-12-23 15:49:53,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c02de4c1-c40c-4f6b-9b40-80c20e21e98b), log id: 7a921f1f >2012-12-23 15:49:53,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] FINISH, HSMClearTaskVDSCommand, log id: 7a921f1f >2012-12-23 15:49:53,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-40) [6b7660a2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@f396b17, log id: 33b1bac5 >2012-12-23 15:49:53,119 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-40) [2a5bad0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:49:53,567 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:49:53,844 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:55,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:49:57,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts >2012-12-23 15:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering 0 hosts >2012-12-23 15:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Checking autorecoverable hosts done >2012-12-23 15:50:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-9) Autorecovering storage domains is disabled, skipping >2012-12-23 15:50:00,386 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:02,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:03,600 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [63262bfe] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:50:03,667 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [63262bfe] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:50:03,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5e6fbe13 >2012-12-23 15:50:03,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] spmStart polling started: taskId = f07e7edb-c8c3-4c05-b05a-994a64e2bcc4 >2012-12-23 15:50:04,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:06,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:08,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:10,667 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:12,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [326e64ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:12,935 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [63262bfe] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:50:12,935 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [63262bfe] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:12,935 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] spmStart polling ended: taskId = f07e7edb-c8c3-4c05-b05a-994a64e2bcc4 task status = finished >2012-12-23 15:50:12,935 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:12,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] spmStart polling ended, spm status: Free >2012-12-23 15:50:12,955 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f07e7edb-c8c3-4c05-b05a-994a64e2bcc4), log id: 39c57bb9 >2012-12-23 15:50:12,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] FINISH, HSMClearTaskVDSCommand, log id: 39c57bb9 >2012-12-23 15:50:12,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [63262bfe] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@543dcc50, log id: 5e6fbe13 >2012-12-23 15:50:12,979 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [2530c365] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:50:13,757 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [2530c365] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:50:14,886 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:17,162 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:19,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:21,295 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:23,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:23,803 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:50:23,817 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [6b4d690d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:50:23,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 9badc4d >2012-12-23 15:50:23,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] spmStart polling started: taskId = 28371564-8670-4357-a751-312707fe25b6 >2012-12-23 15:50:25,701 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:27,914 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:29,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [4ef35d65] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:32,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:33,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [6b4d690d] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:50:33,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [6b4d690d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:33,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] spmStart polling ended: taskId = 28371564-8670-4357-a751-312707fe25b6 task status = finished >2012-12-23 15:50:33,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:33,092 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] spmStart polling ended, spm status: Free >2012-12-23 15:50:33,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=28371564-8670-4357-a751-312707fe25b6), log id: 7eca375f >2012-12-23 15:50:33,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] FINISH, HSMClearTaskVDSCommand, log id: 7eca375f >2012-12-23 15:50:33,113 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [6b4d690d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@df97f01, log id: 9badc4d >2012-12-23 15:50:33,116 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-84) [770121d1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:50:33,854 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [770121d1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:50:34,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:36,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:38,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:40,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:50:42,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:43,882 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:50:43,905 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [4a6f1214] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:50:43,907 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 68c14736 >2012-12-23 15:50:43,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] spmStart polling started: taskId = 2f13a08b-e48d-482e-96a4-f2f1c7985b21 >2012-12-23 15:50:44,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:46,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:48,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:50,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:52,881 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:54,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [4a6f1214] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:50:54,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-100) [4a6f1214] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:54,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] spmStart polling ended: taskId = 2f13a08b-e48d-482e-96a4-f2f1c7985b21 task status = finished >2012-12-23 15:50:54,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:50:54,200 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] spmStart polling ended, spm status: Free >2012-12-23 15:50:54,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=2f13a08b-e48d-482e-96a4-f2f1c7985b21), log id: 5b10faf3 >2012-12-23 15:50:54,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] FINISH, HSMClearTaskVDSCommand, log id: 5b10faf3 >2012-12-23 15:50:54,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-100) [4a6f1214] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@37cb963a, log id: 68c14736 >2012-12-23 15:50:54,226 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-100) [16f3d674] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:50:54,612 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:50:54,923 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:56,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:50:59,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:01,068 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:03,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:04,639 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:51:04,671 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [789b36d0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:51:04,673 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1caf7f9a >2012-12-23 15:51:04,697 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] spmStart polling started: taskId = f749d06f-537b-4902-af2a-486f6e2fbed7 >2012-12-23 15:51:05,895 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:07,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:10,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:12,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [59e6cba7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:14,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:15,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [789b36d0] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:51:15,563 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [789b36d0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:15,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] spmStart polling ended: taskId = f749d06f-537b-4902-af2a-486f6e2fbed7 task status = finished >2012-12-23 15:51:15,563 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:15,582 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] spmStart polling ended, spm status: Free >2012-12-23 15:51:15,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f749d06f-537b-4902-af2a-486f6e2fbed7), log id: 549c8094 >2012-12-23 15:51:15,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] FINISH, HSMClearTaskVDSCommand, log id: 549c8094 >2012-12-23 15:51:15,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [789b36d0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6ebd9ff1, log id: 1caf7f9a >2012-12-23 15:51:15,604 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-45) [634fc003] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:51:15,974 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [634fc003] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:51:16,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:19,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:21,066 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:23,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:25,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:26,000 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [326e64ba] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:51:26,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [326e64ba] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:51:26,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6459a0ee >2012-12-23 15:51:26,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] spmStart polling started: taskId = 844ea30e-0879-4eeb-bf51-5388be7f719b >2012-12-23 15:51:27,659 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:29,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:31,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:33,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:35,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [326e64ba] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:51:35,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [326e64ba] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:35,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] spmStart polling ended: taskId = 844ea30e-0879-4eeb-bf51-5388be7f719b task status = finished >2012-12-23 15:51:35,733 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:35,753 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] spmStart polling ended, spm status: Free >2012-12-23 15:51:35,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=844ea30e-0879-4eeb-bf51-5388be7f719b), log id: 262150e4 >2012-12-23 15:51:35,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] FINISH, HSMClearTaskVDSCommand, log id: 262150e4 >2012-12-23 15:51:35,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [326e64ba] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5545bc4a, log id: 6459a0ee >2012-12-23 15:51:35,776 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [554cca02] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:51:35,825 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:51:36,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:38,065 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:40,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [2b09e308] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:42,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:44,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:45,852 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [770121d1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:51:45,948 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [770121d1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:51:45,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7faf8dbf >2012-12-23 15:51:45,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] spmStart polling started: taskId = f4be304b-262b-42df-af91-1a873a48a88d >2012-12-23 15:51:46,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:48,796 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:50,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:53,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:55,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [770121d1] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:51:55,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [770121d1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:55,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] spmStart polling ended: taskId = f4be304b-262b-42df-af91-1a873a48a88d task status = finished >2012-12-23 15:51:55,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:51:55,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] spmStart polling ended, spm status: Free >2012-12-23 15:51:55,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [770121d1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f4be304b-262b-42df-af91-1a873a48a88d), log id: 729ec832 >2012-12-23 15:51:55,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [770121d1] FINISH, HSMClearTaskVDSCommand, log id: 729ec832 >2012-12-23 15:51:55,231 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [770121d1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@16698568, log id: 7faf8dbf >2012-12-23 15:51:55,234 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-84) [69b57a56] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:51:55,263 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [69b57a56] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:51:55,689 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:57,756 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:51:59,822 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [74c7905] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:01,894 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:06,288 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:52:06,319 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [38d5d554] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:52:06,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6d9b56b7 >2012-12-23 15:52:06,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] spmStart polling started: taskId = ca7de7d3-9953-4f1f-bd1d-c1c73802d6c8 >2012-12-23 15:52:10,977 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:13,010 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:15,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:16,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [38d5d554] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:52:16,597 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [38d5d554] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:16,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] spmStart polling ended: taskId = ca7de7d3-9953-4f1f-bd1d-c1c73802d6c8 task status = finished >2012-12-23 15:52:16,597 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:16,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] spmStart polling ended, spm status: Free >2012-12-23 15:52:16,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ca7de7d3-9953-4f1f-bd1d-c1c73802d6c8), log id: 9f29d37 >2012-12-23 15:52:16,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] FINISH, HSMClearTaskVDSCommand, log id: 9f29d37 >2012-12-23 15:52:16,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-27) [38d5d554] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@172f8afb, log id: 6d9b56b7 >2012-12-23 15:52:16,642 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-27) [324d70a1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:52:16,712 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:52:17,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:19,717 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:21,761 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:23,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [5725638b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:25,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:26,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:52:26,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [4207c949] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:52:26,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5875e920 >2012-12-23 15:52:26,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] spmStart polling started: taskId = abb08ba3-84d3-42f9-a47e-cc423964b96a >2012-12-23 15:52:27,874 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:29,906 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:31,936 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:33,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:36,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:37,054 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [4207c949] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:52:37,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [4207c949] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:37,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] spmStart polling ended: taskId = abb08ba3-84d3-42f9-a47e-cc423964b96a task status = finished >2012-12-23 15:52:37,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:37,073 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] spmStart polling ended, spm status: Free >2012-12-23 15:52:37,075 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [4207c949] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=abb08ba3-84d3-42f9-a47e-cc423964b96a), log id: c5b2739 >2012-12-23 15:52:37,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [4207c949] FINISH, HSMClearTaskVDSCommand, log id: c5b2739 >2012-12-23 15:52:37,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [4207c949] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@346c1585, log id: 5875e920 >2012-12-23 15:52:37,098 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-23) [23f8e9a6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:52:37,457 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [23f8e9a6] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:52:38,088 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:40,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:42,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [2530c365] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:44,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:52:46,938 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:47,491 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [42649289] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:52:47,504 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [42649289] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:52:47,506 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 881cf4c >2012-12-23 15:52:47,529 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] spmStart polling started: taskId = c40d987c-c89f-40fe-a9ad-ac892882cda6 >2012-12-23 15:52:48,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:51,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:53,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [208ee0da] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:55,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:57,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:52:57,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [42649289] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:52:57,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [42649289] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:57,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] spmStart polling ended: taskId = c40d987c-c89f-40fe-a9ad-ac892882cda6 task status = finished >2012-12-23 15:52:57,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:52:57,802 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] spmStart polling ended, spm status: Free >2012-12-23 15:52:57,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [42649289] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c40d987c-c89f-40fe-a9ad-ac892882cda6), log id: b3088c6 >2012-12-23 15:52:57,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [42649289] FINISH, HSMClearTaskVDSCommand, log id: b3088c6 >2012-12-23 15:52:57,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [42649289] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f6384e7, log id: 881cf4c >2012-12-23 15:52:57,824 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-59) [3eaa69ca] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:52:57,865 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [3eaa69ca] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:52:59,634 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:01,669 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:03,770 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:05,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:07,891 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:53:07,916 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [fbf7edf] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:53:07,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 15ea853b >2012-12-23 15:53:07,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] spmStart polling started: taskId = 4be9ecf0-a4ef-4a17-a8ae-f222fc5ef7a6 >2012-12-23 15:53:08,169 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:10,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:12,675 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:14,736 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:16,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:18,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [fbf7edf] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:53:18,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [fbf7edf] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:18,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] spmStart polling ended: taskId = 4be9ecf0-a4ef-4a17-a8ae-f222fc5ef7a6 task status = finished >2012-12-23 15:53:18,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:18,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] spmStart polling ended, spm status: Free >2012-12-23 15:53:18,306 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4be9ecf0-a4ef-4a17-a8ae-f222fc5ef7a6), log id: 6846ee75 >2012-12-23 15:53:18,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] FINISH, HSMClearTaskVDSCommand, log id: 6846ee75 >2012-12-23 15:53:18,333 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [fbf7edf] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@8d178cf, log id: 15ea853b >2012-12-23 15:53:18,336 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-95) [7052628e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:53:18,592 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [7052628e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:53:18,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:20,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:23,222 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:25,543 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:27,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:28,619 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:53:28,679 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [80adee] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:53:28,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5453551c >2012-12-23 15:53:28,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] spmStart polling started: taskId = 9439d76c-b811-42cd-bd2b-80d926f2eeb1 >2012-12-23 15:53:29,654 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:31,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:33,752 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:35,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 15:53:37,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:38,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [80adee] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:53:38,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [80adee] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:38,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] spmStart polling ended: taskId = 9439d76c-b811-42cd-bd2b-80d926f2eeb1 task status = finished >2012-12-23 15:53:38,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:38,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] spmStart polling ended, spm status: Free >2012-12-23 15:53:38,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [80adee] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9439d76c-b811-42cd-bd2b-80d926f2eeb1), log id: 20efa5d3 >2012-12-23 15:53:39,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [80adee] FINISH, HSMClearTaskVDSCommand, log id: 20efa5d3 >2012-12-23 15:53:39,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [80adee] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@556fd089, log id: 5453551c >2012-12-23 15:53:39,021 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [1fe3fe31] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:53:39,062 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [1fe3fe31] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:53:39,926 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [59e6cba7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:42,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:44,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:46,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:48,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:49,089 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [23f8e9a6] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:53:49,108 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [23f8e9a6] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:53:49,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5b0c3303 >2012-12-23 15:53:49,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] spmStart polling started: taskId = d260c315-00fe-4a97-addc-45b7ed4f2e60 >2012-12-23 15:53:50,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:52,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:54,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [2530c365] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:56,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:59,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:53:59,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [23f8e9a6] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:53:59,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [23f8e9a6] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:59,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] spmStart polling ended: taskId = d260c315-00fe-4a97-addc-45b7ed4f2e60 task status = finished >2012-12-23 15:53:59,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:53:59,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] spmStart polling ended, spm status: Free >2012-12-23 15:53:59,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d260c315-00fe-4a97-addc-45b7ed4f2e60), log id: 3182115d >2012-12-23 15:53:59,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] FINISH, HSMClearTaskVDSCommand, log id: 3182115d >2012-12-23 15:53:59,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [23f8e9a6] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@52420a0f, log id: 5b0c3303 >2012-12-23 15:53:59,430 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-23) [6da288f9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:53:59,476 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [6da288f9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:54:01,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:03,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:05,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:07,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:09,529 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:54:09,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [21718bb8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:54:09,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 36590553 >2012-12-23 15:54:09,565 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] spmStart polling started: taskId = 4d96df43-bd62-4677-af43-5b1bed059b83 >2012-12-23 15:54:09,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:11,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) [3eaa69ca] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:14,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:16,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:18,328 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:18,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [21718bb8] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:54:18,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-5) [21718bb8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:54:18,798 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] spmStart polling ended: taskId = 4d96df43-bd62-4677-af43-5b1bed059b83 task status = finished >2012-12-23 15:54:18,799 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:54:18,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] spmStart polling ended, spm status: Free >2012-12-23 15:54:18,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4d96df43-bd62-4677-af43-5b1bed059b83), log id: 6c439158 >2012-12-23 15:54:18,837 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] FINISH, HSMClearTaskVDSCommand, log id: 6c439158 >2012-12-23 15:54:18,837 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-5) [21718bb8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@47fb5fef, log id: 36590553 >2012-12-23 15:54:18,839 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-5) [485768d4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:54:18,937 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:54:20,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:23,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [69b57a56] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:26,277 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:28,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:54:29,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:54:29,075 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6f7fdad9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:54:29,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 496537f3 >2012-12-23 15:54:29,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] spmStart polling started: taskId = 67c4b407-19f1-4c37-9349-be89e8805378 >2012-12-23 15:54:40,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [6f7fdad9] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:54:40,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [6f7fdad9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:54:40,353 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] spmStart polling ended: taskId = 67c4b407-19f1-4c37-9349-be89e8805378 task status = finished >2012-12-23 15:54:40,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:54:40,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] spmStart polling ended, spm status: Free >2012-12-23 15:54:40,374 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=67c4b407-19f1-4c37-9349-be89e8805378), log id: 1505f544 >2012-12-23 15:54:40,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] FINISH, HSMClearTaskVDSCommand, log id: 1505f544 >2012-12-23 15:54:40,393 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6f7fdad9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3a294e24, log id: 496537f3 >2012-12-23 15:54:40,397 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-62) [6dc93b50] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:54:40,425 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:54:50,452 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:54:50,468 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:54:50,470 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 776bfeac >2012-12-23 15:54:50,494 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) spmStart polling started: taskId = 075949e0-e2fd-4e06-b551-b91edc4442f2 >2012-12-23 15:55:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts >2012-12-23 15:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering 0 hosts >2012-12-23 15:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Checking autorecoverable hosts done >2012-12-23 15:55:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-41) Autorecovering storage domains is disabled, skipping >2012-12-23 15:55:00,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) Failed in HSMGetTaskStatusVDS method >2012-12-23 15:55:00,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:00,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) spmStart polling ended: taskId = 075949e0-e2fd-4e06-b551-b91edc4442f2 task status = finished >2012-12-23 15:55:00,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:00,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) spmStart polling ended, spm status: Free >2012-12-23 15:55:00,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=075949e0-e2fd-4e06-b551-b91edc4442f2), log id: 707ff5c3 >2012-12-23 15:55:00,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) FINISH, HSMClearTaskVDSCommand, log id: 707ff5c3 >2012-12-23 15:55:00,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@60e00ee8, log id: 776bfeac >2012-12-23 15:55:00,776 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-37) [15f2d308] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:55:00,857 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:55:10,884 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [634fc003] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:55:10,896 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [634fc003] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:55:10,898 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 490fa54d >2012-12-23 15:55:10,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] spmStart polling started: taskId = 866cbc7b-6a40-4ab6-8718-704789c3c7d9 >2012-12-23 15:55:21,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [634fc003] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:55:21,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-45) [634fc003] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:21,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] spmStart polling ended: taskId = 866cbc7b-6a40-4ab6-8718-704789c3c7d9 task status = finished >2012-12-23 15:55:21,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:21,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] spmStart polling ended, spm status: Free >2012-12-23 15:55:21,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [634fc003] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=866cbc7b-6a40-4ab6-8718-704789c3c7d9), log id: 3dcaab15 >2012-12-23 15:55:21,217 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-45) [634fc003] FINISH, HSMClearTaskVDSCommand, log id: 3dcaab15 >2012-12-23 15:55:21,218 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-45) [634fc003] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@44a60f64, log id: 490fa54d >2012-12-23 15:55:21,221 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-45) [723c9171] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:55:21,271 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:55:31,327 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:55:31,393 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [34cca6e8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:55:31,394 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4e36dce >2012-12-23 15:55:31,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] spmStart polling started: taskId = 34d50712-d5f7-4417-bfd3-9d00b68c8398 >2012-12-23 15:55:41,692 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [34cca6e8] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:55:41,692 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [34cca6e8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:41,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] spmStart polling ended: taskId = 34d50712-d5f7-4417-bfd3-9d00b68c8398 task status = finished >2012-12-23 15:55:41,692 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:55:41,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] spmStart polling ended, spm status: Free >2012-12-23 15:55:41,713 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=34d50712-d5f7-4417-bfd3-9d00b68c8398), log id: 40e1f8f6 >2012-12-23 15:55:41,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] FINISH, HSMClearTaskVDSCommand, log id: 40e1f8f6 >2012-12-23 15:55:41,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [34cca6e8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@339fffc1, log id: 4e36dce >2012-12-23 15:55:41,734 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [4d4ff261] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:55:41,763 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:55:51,790 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [3eaa69ca] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:55:51,816 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [3eaa69ca] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:55:51,817 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2390d065 >2012-12-23 15:55:51,841 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] spmStart polling started: taskId = 6859d8f0-765b-4988-b315-01fb774029c2 >2012-12-23 15:56:02,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [3eaa69ca] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:56:02,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-59) [3eaa69ca] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:02,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] spmStart polling ended: taskId = 6859d8f0-765b-4988-b315-01fb774029c2 task status = finished >2012-12-23 15:56:02,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:02,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] spmStart polling ended, spm status: Free >2012-12-23 15:56:02,211 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6859d8f0-765b-4988-b315-01fb774029c2), log id: 775612e0 >2012-12-23 15:56:02,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] FINISH, HSMClearTaskVDSCommand, log id: 775612e0 >2012-12-23 15:56:02,230 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-59) [3eaa69ca] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@33f16d55, log id: 2390d065 >2012-12-23 15:56:02,233 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-59) [2f410217] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:56:02,271 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-59) [2f410217] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:56:12,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:56:12,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [4cd2eee5] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:56:12,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2da35aca >2012-12-23 15:56:12,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] spmStart polling started: taskId = 24f82352-7231-4421-909f-474bb3d2789e >2012-12-23 15:56:22,601 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [4cd2eee5] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:56:22,601 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [4cd2eee5] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:22,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] spmStart polling ended: taskId = 24f82352-7231-4421-909f-474bb3d2789e task status = finished >2012-12-23 15:56:22,601 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:22,620 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] spmStart polling ended, spm status: Free >2012-12-23 15:56:22,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=24f82352-7231-4421-909f-474bb3d2789e), log id: 3eb3714d >2012-12-23 15:56:22,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] FINISH, HSMClearTaskVDSCommand, log id: 3eb3714d >2012-12-23 15:56:22,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [4cd2eee5] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@76d39663, log id: 2da35aca >2012-12-23 15:56:22,707 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [43a65476] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:56:22,876 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:56:32,903 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:56:37,806 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [756fe3f8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:56:37,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3602808b >2012-12-23 15:56:37,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] spmStart polling started: taskId = b2b834c4-e74d-4247-9396-0684f4ef8c88 >2012-12-23 15:56:43,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [756fe3f8] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:56:43,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [756fe3f8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:43,989 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] spmStart polling ended: taskId = b2b834c4-e74d-4247-9396-0684f4ef8c88 task status = finished >2012-12-23 15:56:43,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:56:44,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] spmStart polling ended, spm status: Free >2012-12-23 15:56:44,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b2b834c4-e74d-4247-9396-0684f4ef8c88), log id: 45954af9 >2012-12-23 15:56:44,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] FINISH, HSMClearTaskVDSCommand, log id: 45954af9 >2012-12-23 15:56:44,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [756fe3f8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4c6d451f, log id: 3602808b >2012-12-23 15:56:44,031 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-31) [19d51d6c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:56:47,326 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [19d51d6c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:56:57,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [5725638b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:57:06,342 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [5725638b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:57:06,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 62b39d74 >2012-12-23 15:57:06,370 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] spmStart polling started: taskId = b9045533-4a68-476a-b97b-3cead21b2561 >2012-12-23 15:57:23,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5725638b] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:57:23,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [5725638b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:57:23,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] spmStart polling ended: taskId = b9045533-4a68-476a-b97b-3cead21b2561 task status = finished >2012-12-23 15:57:23,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:57:23,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] spmStart polling ended, spm status: Free >2012-12-23 15:57:23,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [5725638b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b9045533-4a68-476a-b97b-3cead21b2561), log id: 1552ba40 >2012-12-23 15:57:23,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [5725638b] FINISH, HSMClearTaskVDSCommand, log id: 1552ba40 >2012-12-23 15:57:23,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [5725638b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6a41caaf, log id: 62b39d74 >2012-12-23 15:57:23,819 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-52) [561dda9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:57:24,127 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:57:30,585 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 15:57:32,624 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:34,163 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:57:34,177 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [752f04d2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:57:34,179 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 41affb08 >2012-12-23 15:57:34,202 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] spmStart polling started: taskId = dd12235d-62bd-4569-9fa7-eed964c9eb73 >2012-12-23 15:57:34,659 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:36,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:38,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:40,959 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:42,991 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:44,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [752f04d2] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:57:44,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [752f04d2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:57:44,459 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] spmStart polling ended: taskId = dd12235d-62bd-4569-9fa7-eed964c9eb73 task status = finished >2012-12-23 15:57:44,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:57:44,483 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] spmStart polling ended, spm status: Free >2012-12-23 15:57:44,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=dd12235d-62bd-4569-9fa7-eed964c9eb73), log id: 15201a80 >2012-12-23 15:57:44,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] FINISH, HSMClearTaskVDSCommand, log id: 15201a80 >2012-12-23 15:57:44,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [752f04d2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6eabd455, log id: 41affb08 >2012-12-23 15:57:44,513 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-50) [53015136] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:57:44,560 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [53015136] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:57:45,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:47,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:49,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [208ee0da] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:51,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:53,812 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:54,587 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [4ef35d65] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:57:54,624 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [4ef35d65] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:57:54,625 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: a99c272 >2012-12-23 15:57:54,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] spmStart polling started: taskId = d6368d70-36e4-472e-b53a-4313be026d69 >2012-12-23 15:57:55,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:57:57,945 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:00,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) [2f410217] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:02,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:04,545 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:04,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [4ef35d65] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:58:04,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-61) [4ef35d65] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:04,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] spmStart polling ended: taskId = d6368d70-36e4-472e-b53a-4313be026d69 task status = finished >2012-12-23 15:58:04,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:04,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] spmStart polling ended, spm status: Free >2012-12-23 15:58:04,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d6368d70-36e4-472e-b53a-4313be026d69), log id: 7eab0cf6 >2012-12-23 15:58:04,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] FINISH, HSMClearTaskVDSCommand, log id: 7eab0cf6 >2012-12-23 15:58:04,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-61) [4ef35d65] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@fe02b72, log id: a99c272 >2012-12-23 15:58:04,945 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-61) [46445182] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:58:04,975 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-61) [46445182] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:58:06,583 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [69b57a56] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:08,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:10,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:12,866 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:15,000 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [7052628e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:58:15,126 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:15,339 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [7052628e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:58:15,342 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2dba6d22 >2012-12-23 15:58:15,369 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] spmStart polling started: taskId = db77116b-2f6d-43ef-92dc-f7b6b6e59d38 >2012-12-23 15:58:17,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:19,474 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:21,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:23,572 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [19d51d6c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:26,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [7052628e] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:58:26,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [7052628e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:26,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] spmStart polling ended: taskId = db77116b-2f6d-43ef-92dc-f7b6b6e59d38 task status = finished >2012-12-23 15:58:26,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:26,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:26,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] spmStart polling ended, spm status: Free >2012-12-23 15:58:26,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [7052628e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=db77116b-2f6d-43ef-92dc-f7b6b6e59d38), log id: 3c39dcd3 >2012-12-23 15:58:26,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [7052628e] FINISH, HSMClearTaskVDSCommand, log id: 3c39dcd3 >2012-12-23 15:58:26,183 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [7052628e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@216214cd, log id: 2dba6d22 >2012-12-23 15:58:26,187 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-95) [2e43afda] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:58:26,228 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:58:28,209 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:30,286 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:32,365 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:34,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:36,255 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [59e6cba7] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:58:36,267 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [59e6cba7] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:58:36,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 25f7b0c3 >2012-12-23 15:58:36,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] spmStart polling started: taskId = a4d705af-72e8-4cf0-9f11-51c5120d82de >2012-12-23 15:58:36,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:38,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:41,053 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:43,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:45,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:45,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [59e6cba7] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:58:45,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-54) [59e6cba7] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:45,525 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] spmStart polling ended: taskId = a4d705af-72e8-4cf0-9f11-51c5120d82de task status = finished >2012-12-23 15:58:45,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:58:45,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] spmStart polling ended, spm status: Free >2012-12-23 15:58:45,544 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a4d705af-72e8-4cf0-9f11-51c5120d82de), log id: 25fe5257 >2012-12-23 15:58:45,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] FINISH, HSMClearTaskVDSCommand, log id: 25fe5257 >2012-12-23 15:58:45,563 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-54) [59e6cba7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5bcfe13d, log id: 25f7b0c3 >2012-12-23 15:58:45,565 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:58:45,595 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:58:47,363 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:49,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:51,614 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:53,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:55,631 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:58:55,652 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [4e762a52] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:58:55,654 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 45bc07af >2012-12-23 15:58:55,676 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] spmStart polling started: taskId = c0f88289-bbbc-4d8e-89fa-d74a3c526751 >2012-12-23 15:58:56,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:58:58,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:00,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:02,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:04,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:06,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:07,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [4e762a52] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:59:07,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-7) [4e762a52] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:07,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] spmStart polling ended: taskId = c0f88289-bbbc-4d8e-89fa-d74a3c526751 task status = finished >2012-12-23 15:59:07,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:07,029 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] spmStart polling ended, spm status: Free >2012-12-23 15:59:07,031 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c0f88289-bbbc-4d8e-89fa-d74a3c526751), log id: 623e7716 >2012-12-23 15:59:07,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] FINISH, HSMClearTaskVDSCommand, log id: 623e7716 >2012-12-23 15:59:07,050 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-7) [4e762a52] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@72fc77bd, log id: 45bc07af >2012-12-23 15:59:07,054 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-7) [1d195445] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:59:07,117 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-7) [1d195445] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:59:09,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:11,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:13,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:16,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:17,143 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:59:17,155 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [20ed4521] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:59:17,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4e8fdc4a >2012-12-23 15:59:17,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] spmStart polling started: taskId = bb8b19f2-2f85-41f2-aa72-fe3fb4a9d253 >2012-12-23 15:59:18,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [46445182] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:20,108 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:22,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:24,268 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [74c7905] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:26,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:27,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [20ed4521] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:59:27,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [20ed4521] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:27,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] spmStart polling ended: taskId = bb8b19f2-2f85-41f2-aa72-fe3fb4a9d253 task status = finished >2012-12-23 15:59:27,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:27,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] spmStart polling ended, spm status: Free >2012-12-23 15:59:27,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bb8b19f2-2f85-41f2-aa72-fe3fb4a9d253), log id: 72665a2c >2012-12-23 15:59:27,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] FINISH, HSMClearTaskVDSCommand, log id: 72665a2c >2012-12-23 15:59:27,460 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [20ed4521] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1daa3961, log id: 4e8fdc4a >2012-12-23 15:59:27,462 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [129d1e7e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:59:27,501 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:59:28,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:30,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:32,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:34,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:37,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:37,527 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [19d51d6c] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:59:38,357 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [19d51d6c] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:59:38,360 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: d58b08e >2012-12-23 15:59:38,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] spmStart polling started: taskId = f383da12-3aa3-4294-bd69-8f5642692e4f >2012-12-23 15:59:40,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:42,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:45,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:47,148 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [1fe3fe31] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:47,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [19d51d6c] Failed in HSMGetTaskStatusVDS method >2012-12-23 15:59:47,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [19d51d6c] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:47,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] spmStart polling ended: taskId = f383da12-3aa3-4294-bd69-8f5642692e4f task status = finished >2012-12-23 15:59:47,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 15:59:47,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] spmStart polling ended, spm status: Free >2012-12-23 15:59:47,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f383da12-3aa3-4294-bd69-8f5642692e4f), log id: 545e3894 >2012-12-23 15:59:47,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] FINISH, HSMClearTaskVDSCommand, log id: 545e3894 >2012-12-23 15:59:47,636 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [19d51d6c] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75d4a7d1, log id: d58b08e >2012-12-23 15:59:47,641 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-31) [5c55c6c6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 15:59:47,671 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 15:59:49,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:51,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 15:59:57,697 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 15:59:57,711 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [5bf8b395] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 15:59:57,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 53b28780 >2012-12-23 15:59:57,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] spmStart polling started: taskId = d2a23f5e-ef46-4a94-8c3f-d47f694e8e80 >2012-12-23 16:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) [164f3d32] Checking autorecoverable hosts >2012-12-23 16:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) [164f3d32] Autorecovering 0 hosts >2012-12-23 16:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) [164f3d32] Checking autorecoverable hosts done >2012-12-23 16:00:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-82) [164f3d32] Autorecovering storage domains is disabled, skipping >2012-12-23 16:00:07,957 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [5bf8b395] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:00:07,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [5bf8b395] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:07,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] spmStart polling ended: taskId = d2a23f5e-ef46-4a94-8c3f-d47f694e8e80 task status = finished >2012-12-23 16:00:07,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:07,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] spmStart polling ended, spm status: Free >2012-12-23 16:00:07,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d2a23f5e-ef46-4a94-8c3f-d47f694e8e80), log id: 57850a29 >2012-12-23 16:00:07,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] FINISH, HSMClearTaskVDSCommand, log id: 57850a29 >2012-12-23 16:00:07,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [5bf8b395] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5f5e36a2, log id: 53b28780 >2012-12-23 16:00:08,004 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-65) [2254f698] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:00:08,030 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2254f698] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:00:18,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [53015136] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:00:18,400 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [53015136] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:00:18,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7a52521f >2012-12-23 16:00:18,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] spmStart polling started: taskId = e1779893-ce4e-4a55-a29b-cd564f249c59 >2012-12-23 16:00:25,203 WARN [org.ovirt.engine.core.bll.MaintananceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-3) CanDoAction of action MaintananceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_RESPONDING_WITH_VMS,$HostNotResponding orchid-vds1 >2012-12-23 16:00:28,682 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [53015136] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:00:28,682 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-50) [53015136] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:28,682 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] spmStart polling ended: taskId = e1779893-ce4e-4a55-a29b-cd564f249c59 task status = finished >2012-12-23 16:00:28,682 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:28,715 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] spmStart polling ended, spm status: Free >2012-12-23 16:00:28,716 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [53015136] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e1779893-ce4e-4a55-a29b-cd564f249c59), log id: 2112a63e >2012-12-23 16:00:28,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-50) [53015136] FINISH, HSMClearTaskVDSCommand, log id: 2112a63e >2012-12-23 16:00:28,746 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-50) [53015136] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4f604168, log id: 7a52521f >2012-12-23 16:00:28,749 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-50) [38663b8e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:00:29,062 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:00:39,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:00:39,465 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:00:39,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7850ab8b >2012-12-23 16:00:39,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) spmStart polling started: taskId = 029d99f2-4c99-4e54-afc5-87310bd2dbc8 >2012-12-23 16:00:49,736 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:00:49,736 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:49,737 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) spmStart polling ended: taskId = 029d99f2-4c99-4e54-afc5-87310bd2dbc8 task status = finished >2012-12-23 16:00:49,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:00:49,755 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) spmStart polling ended, spm status: Free >2012-12-23 16:00:49,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=029d99f2-4c99-4e54-afc5-87310bd2dbc8), log id: 2b8900e >2012-12-23 16:00:49,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) FINISH, HSMClearTaskVDSCommand, log id: 2b8900e >2012-12-23 16:00:49,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@22f98887, log id: 7850ab8b >2012-12-23 16:00:49,778 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [2c726901] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:00:49,809 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:00:59,836 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [74c7905] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:00:59,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [74c7905] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:00:59,909 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5d74370 >2012-12-23 16:00:59,941 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] spmStart polling started: taskId = 88d215ca-bc27-4bdd-9735-6f47db376828 >2012-12-23 16:01:10,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [74c7905] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:01:10,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [74c7905] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:10,199 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] spmStart polling ended: taskId = 88d215ca-bc27-4bdd-9735-6f47db376828 task status = finished >2012-12-23 16:01:10,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:10,219 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] spmStart polling ended, spm status: Free >2012-12-23 16:01:10,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [74c7905] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=88d215ca-bc27-4bdd-9735-6f47db376828), log id: 47a043f8 >2012-12-23 16:01:10,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [74c7905] FINISH, HSMClearTaskVDSCommand, log id: 47a043f8 >2012-12-23 16:01:10,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [74c7905] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6ace7384, log id: 5d74370 >2012-12-23 16:01:10,241 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [180215e4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:01:10,520 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [180215e4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:01:20,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:01:20,556 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [5e62365e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:01:20,557 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3cb9a148 >2012-12-23 16:01:20,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] spmStart polling started: taskId = 1ca2bc5f-590e-4551-9e70-ce5d62a97b69 >2012-12-23 16:01:30,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [5e62365e] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:01:30,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-12) [5e62365e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:30,829 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] spmStart polling ended: taskId = 1ca2bc5f-590e-4551-9e70-ce5d62a97b69 task status = finished >2012-12-23 16:01:30,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:30,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] spmStart polling ended, spm status: Free >2012-12-23 16:01:30,850 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1ca2bc5f-590e-4551-9e70-ce5d62a97b69), log id: 43526e72 >2012-12-23 16:01:30,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] FINISH, HSMClearTaskVDSCommand, log id: 43526e72 >2012-12-23 16:01:30,870 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-12) [5e62365e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@58d120e5, log id: 3cb9a148 >2012-12-23 16:01:30,872 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-12) [9c6c7f1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:01:31,730 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:01:41,757 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:01:41,768 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [5728d6f0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:01:41,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7c7ea0c7 >2012-12-23 16:01:41,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] spmStart polling started: taskId = 1ad7d7e3-9282-496b-8efe-786cab998a8b >2012-12-23 16:01:51,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [5728d6f0] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:01:51,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [5728d6f0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:51,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] spmStart polling ended: taskId = 1ad7d7e3-9282-496b-8efe-786cab998a8b task status = finished >2012-12-23 16:01:51,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:01:51,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] spmStart polling ended, spm status: Free >2012-12-23 16:01:51,036 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1ad7d7e3-9282-496b-8efe-786cab998a8b), log id: 3fd251e >2012-12-23 16:01:51,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] FINISH, HSMClearTaskVDSCommand, log id: 3fd251e >2012-12-23 16:01:51,055 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [5728d6f0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@608fd69d, log id: 7c7ea0c7 >2012-12-23 16:01:51,057 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-42) [3530ef2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:01:51,098 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:02:01,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [2530c365] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:02:01,218 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [2530c365] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:02:01,220 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4692225d >2012-12-23 16:02:01,244 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] spmStart polling started: taskId = 74897b83-9f65-4790-9bcf-a80aa75f313c >2012-12-23 16:02:11,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [2530c365] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:02:11,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [2530c365] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:11,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] spmStart polling ended: taskId = 74897b83-9f65-4790-9bcf-a80aa75f313c task status = finished >2012-12-23 16:02:11,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:11,488 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] spmStart polling ended, spm status: Free >2012-12-23 16:02:11,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [2530c365] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=74897b83-9f65-4790-9bcf-a80aa75f313c), log id: 48f63380 >2012-12-23 16:02:11,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [2530c365] FINISH, HSMClearTaskVDSCommand, log id: 48f63380 >2012-12-23 16:02:11,510 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [2530c365] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1baf3dec, log id: 4692225d >2012-12-23 16:02:11,513 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [e0a5f27] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:02:11,571 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [e0a5f27] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:02:21,597 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [208ee0da] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:02:21,659 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [208ee0da] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:02:21,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 273aa5e >2012-12-23 16:02:21,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] spmStart polling started: taskId = f06003d5-84ff-491b-9ac3-d9bb0afbf86b >2012-12-23 16:02:31,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [208ee0da] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:02:31,994 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [208ee0da] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:31,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] spmStart polling ended: taskId = f06003d5-84ff-491b-9ac3-d9bb0afbf86b task status = finished >2012-12-23 16:02:31,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:32,014 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] spmStart polling ended, spm status: Free >2012-12-23 16:02:32,016 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f06003d5-84ff-491b-9ac3-d9bb0afbf86b), log id: 3a440ea >2012-12-23 16:02:32,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] FINISH, HSMClearTaskVDSCommand, log id: 3a440ea >2012-12-23 16:02:32,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [208ee0da] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@14a1c484, log id: 273aa5e >2012-12-23 16:02:32,038 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [86cc0b1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:02:32,190 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [86cc0b1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:02:34,052 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-7) [bc01661] Running command: LogoutUserCommand internal: false. >2012-12-23 16:02:42,216 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:02:42,583 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [4cede70f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:02:42,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 50bee838 >2012-12-23 16:02:42,609 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] spmStart polling started: taskId = 81588b7b-a966-4a80-8f8d-eb0423e5473d >2012-12-23 16:02:52,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [4cede70f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:02:52,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [4cede70f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:52,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] spmStart polling ended: taskId = 81588b7b-a966-4a80-8f8d-eb0423e5473d task status = finished >2012-12-23 16:02:52,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:02:52,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] spmStart polling ended, spm status: Free >2012-12-23 16:02:52,869 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=81588b7b-a966-4a80-8f8d-eb0423e5473d), log id: 655f4fb4 >2012-12-23 16:02:52,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] FINISH, HSMClearTaskVDSCommand, log id: 655f4fb4 >2012-12-23 16:02:52,889 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [4cede70f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5469e66a, log id: 50bee838 >2012-12-23 16:02:52,894 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-92) [74966471] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:02:53,018 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [74966471] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:02:53,342 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:03:03,043 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:03:03,057 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:03:03,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2411ca0d >2012-12-23 16:03:03,080 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) spmStart polling started: taskId = 1ddbfc60-6337-41a5-8c63-f1aaea549901 >2012-12-23 16:03:13,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:03:13,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-30) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:13,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) spmStart polling ended: taskId = 1ddbfc60-6337-41a5-8c63-f1aaea549901 task status = finished >2012-12-23 16:03:13,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:13,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) spmStart polling ended, spm status: Free >2012-12-23 16:03:13,352 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-30) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1ddbfc60-6337-41a5-8c63-f1aaea549901), log id: 1f59ffb7 >2012-12-23 16:03:13,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-30) FINISH, HSMClearTaskVDSCommand, log id: 1f59ffb7 >2012-12-23 16:03:13,371 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-30) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4da35775, log id: 2411ca0d >2012-12-23 16:03:13,374 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-30) [1ec2ea25] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:03:14,421 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:03:24,459 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [1fe3fe31] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:03:24,584 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [1fe3fe31] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:03:24,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74497df4 >2012-12-23 16:03:24,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] spmStart polling started: taskId = 99dcf159-94f1-4fc1-8067-f9e5c2ad015c >2012-12-23 16:03:31,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:33,915 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:33,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [1fe3fe31] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:03:33,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [1fe3fe31] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:33,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] spmStart polling ended: taskId = 99dcf159-94f1-4fc1-8067-f9e5c2ad015c task status = finished >2012-12-23 16:03:33,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:33,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] spmStart polling ended, spm status: Free >2012-12-23 16:03:33,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=99dcf159-94f1-4fc1-8067-f9e5c2ad015c), log id: 494f71c9 >2012-12-23 16:03:34,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] FINISH, HSMClearTaskVDSCommand, log id: 494f71c9 >2012-12-23 16:03:34,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [1fe3fe31] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7eb768b8, log id: 74497df4 >2012-12-23 16:03:34,021 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [3b3c4906] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:03:34,694 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [3b3c4906] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:03:36,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:38,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:41,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:43,240 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:44,721 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:03:44,820 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:03:44,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 8ea990d >2012-12-23 16:03:44,846 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) spmStart polling started: taskId = 953a95a6-ea46-4c7e-8773-0fb31a47c0f5 >2012-12-23 16:03:45,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:47,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:49,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [e0a5f27] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:51,580 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:53,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:55,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:03:55,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-86) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:55,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) spmStart polling ended: taskId = 953a95a6-ea46-4c7e-8773-0fb31a47c0f5 task status = finished >2012-12-23 16:03:55,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:03:55,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) spmStart polling ended, spm status: Free >2012-12-23 16:03:55,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-86) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=953a95a6-ea46-4c7e-8773-0fb31a47c0f5), log id: 5310bfeb >2012-12-23 16:03:55,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-86) FINISH, HSMClearTaskVDSCommand, log id: 5310bfeb >2012-12-23 16:03:55,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-86) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@70a807e7, log id: 8ea990d >2012-12-23 16:03:55,140 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-86) [279f0879] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:03:55,531 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:03:56,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:03:58,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:01,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:03,234 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:05,289 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:05,558 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:04:05,581 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [63e6e717] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:04:05,583 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 287fe9d4 >2012-12-23 16:04:05,607 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] spmStart polling started: taskId = bf13affd-4a01-499e-84ea-e5372a77a152 >2012-12-23 16:04:07,396 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:09,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:11,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [46445182] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:13,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:13,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [63e6e717] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:04:13,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-25) [63e6e717] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:13,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] spmStart polling ended: taskId = bf13affd-4a01-499e-84ea-e5372a77a152 task status = finished >2012-12-23 16:04:13,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:13,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] spmStart polling ended, spm status: Free >2012-12-23 16:04:13,827 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=bf13affd-4a01-499e-84ea-e5372a77a152), log id: 4eb92bfd >2012-12-23 16:04:13,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] FINISH, HSMClearTaskVDSCommand, log id: 4eb92bfd >2012-12-23 16:04:13,847 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-25) [63e6e717] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5ef7176b, log id: 287fe9d4 >2012-12-23 16:04:13,853 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-25) [3022a282] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:04:14,263 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:04:16,241 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:18,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:20,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:22,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:24,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [180215e4] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:04:24,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [180215e4] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:04:24,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 553188b9 >2012-12-23 16:04:24,350 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] spmStart polling started: taskId = b5f0f866-ebe4-483d-97f0-91479582137e >2012-12-23 16:04:24,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:26,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:28,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:31,136 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:33,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:34,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [180215e4] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:04:34,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [180215e4] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:34,944 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] spmStart polling ended: taskId = b5f0f866-ebe4-483d-97f0-91479582137e task status = finished >2012-12-23 16:04:34,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:34,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] spmStart polling ended, spm status: Free >2012-12-23 16:04:34,965 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [180215e4] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b5f0f866-ebe4-483d-97f0-91479582137e), log id: 3d58a29c >2012-12-23 16:04:34,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [180215e4] FINISH, HSMClearTaskVDSCommand, log id: 3d58a29c >2012-12-23 16:04:34,984 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [180215e4] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@61bcf3b, log id: 553188b9 >2012-12-23 16:04:34,989 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [bc22d9f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:04:35,066 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [bc22d9f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:04:35,260 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:37,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:39,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:41,818 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:43,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:45,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:04:45,137 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:04:45,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1b063264 >2012-12-23 16:04:45,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) spmStart polling started: taskId = b586d79b-9bb2-4a83-9d3d-2f9fa99fb8e9 >2012-12-23 16:04:46,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:49,096 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:51,199 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:53,240 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:54,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:04:54,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:54,359 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) spmStart polling ended: taskId = b586d79b-9bb2-4a83-9d3d-2f9fa99fb8e9 task status = finished >2012-12-23 16:04:54,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:04:54,379 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) spmStart polling ended, spm status: Free >2012-12-23 16:04:54,381 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-9) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b586d79b-9bb2-4a83-9d3d-2f9fa99fb8e9), log id: 3f1c4f23 >2012-12-23 16:04:54,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-9) FINISH, HSMClearTaskVDSCommand, log id: 3f1c4f23 >2012-12-23 16:04:54,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5b8fa333, log id: 1b063264 >2012-12-23 16:04:54,404 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-9) [3323983b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:04:54,480 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [3323983b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:04:55,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:57,387 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:04:59,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [3d4c3194] Checking autorecoverable hosts >2012-12-23 16:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [3d4c3194] Autorecovering 0 hosts >2012-12-23 16:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [3d4c3194] Checking autorecoverable hosts done >2012-12-23 16:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-87) [3d4c3194] Autorecovering storage domains is disabled, skipping >2012-12-23 16:05:01,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:03,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [e0a5f27] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:04,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:05:04,593 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [7a0ae25] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:05:04,595 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2dbed3d5 >2012-12-23 16:05:04,619 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] spmStart polling started: taskId = 21560252-bbf2-4b02-b151-3fa434a8d11c >2012-12-23 16:05:05,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:08,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:10,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:12,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:14,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:15,911 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [7a0ae25] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:05:15,911 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-88) [7a0ae25] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:15,912 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] spmStart polling ended: taskId = 21560252-bbf2-4b02-b151-3fa434a8d11c task status = finished >2012-12-23 16:05:15,912 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:15,930 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] spmStart polling ended, spm status: Free >2012-12-23 16:05:15,931 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=21560252-bbf2-4b02-b151-3fa434a8d11c), log id: 70b41dcc >2012-12-23 16:05:15,949 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] FINISH, HSMClearTaskVDSCommand, log id: 70b41dcc >2012-12-23 16:05:15,950 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-88) [7a0ae25] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@411075e2, log id: 2dbed3d5 >2012-12-23 16:05:15,952 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-88) [1fab69cd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:05:16,088 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-88) [1fab69cd] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:05:16,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:18,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:21,670 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:24,184 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:26,114 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [69b57a56] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:05:26,126 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [69b57a56] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:05:26,128 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5f975d88 >2012-12-23 16:05:26,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] spmStart polling started: taskId = 2d43f7fe-727a-4a80-8e01-12dfed0cd15f >2012-12-23 16:05:26,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:28,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:30,939 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:33,312 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:05:35,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:36,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [69b57a56] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:05:36,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [69b57a56] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:36,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] spmStart polling ended: taskId = 2d43f7fe-727a-4a80-8e01-12dfed0cd15f task status = finished >2012-12-23 16:05:36,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:36,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] spmStart polling ended, spm status: Free >2012-12-23 16:05:36,427 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=2d43f7fe-727a-4a80-8e01-12dfed0cd15f), log id: 4709a967 >2012-12-23 16:05:36,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] FINISH, HSMClearTaskVDSCommand, log id: 4709a967 >2012-12-23 16:05:36,446 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [69b57a56] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4b50cda0, log id: 5f975d88 >2012-12-23 16:05:36,451 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-84) [25ebea01] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:05:36,540 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:05:37,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:39,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:42,044 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:44,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:46,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:46,568 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [bc22d9f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:05:46,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [bc22d9f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:05:46,579 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2a941e34 >2012-12-23 16:05:46,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] spmStart polling started: taskId = 89cd475a-8bfd-4241-92e7-d031eb596ee2 >2012-12-23 16:05:48,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:50,969 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:53,008 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:55,071 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:05:55,851 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [bc22d9f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:05:55,851 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [bc22d9f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:55,851 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] spmStart polling ended: taskId = 89cd475a-8bfd-4241-92e7-d031eb596ee2 task status = finished >2012-12-23 16:05:55,851 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:05:55,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] spmStart polling ended, spm status: Free >2012-12-23 16:05:55,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=89cd475a-8bfd-4241-92e7-d031eb596ee2), log id: 451f7bde >2012-12-23 16:05:55,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] FINISH, HSMClearTaskVDSCommand, log id: 451f7bde >2012-12-23 16:05:55,895 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [bc22d9f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@15fd4f46, log id: 2a941e34 >2012-12-23 16:05:55,897 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [295f87f1] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:05:55,938 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [295f87f1] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:05:57,131 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:06,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [3b3c4906] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:06:07,020 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [3b3c4906] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:06:07,022 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: cae604d >2012-12-23 16:06:07,046 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] spmStart polling started: taskId = 9dcac047-3928-4066-a5ca-cc62a4fa3fb6 >2012-12-23 16:06:14,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:16,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [3b3c4906] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:06:16,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [3b3c4906] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:16,251 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] spmStart polling ended: taskId = 9dcac047-3928-4066-a5ca-cc62a4fa3fb6 task status = finished >2012-12-23 16:06:16,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:16,271 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] spmStart polling ended, spm status: Free >2012-12-23 16:06:16,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9dcac047-3928-4066-a5ca-cc62a4fa3fb6), log id: 56916c3c >2012-12-23 16:06:16,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] FINISH, HSMClearTaskVDSCommand, log id: 56916c3c >2012-12-23 16:06:16,292 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [3b3c4906] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6559038a, log id: cae604d >2012-12-23 16:06:16,294 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [36f78d01] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:06:16,467 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [36f78d01] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:06:16,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:18,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:21,024 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:23,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:25,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:26,495 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2254f698] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:06:26,518 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2254f698] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:06:26,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4c3d074 >2012-12-23 16:06:26,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] spmStart polling started: taskId = 8b755a2f-22b7-43f5-ae6f-79ecb30981cf >2012-12-23 16:06:27,286 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:29,329 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:31,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:33,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [6da288f9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:35,563 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:06:37,599 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:37,804 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [2254f698] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:06:37,804 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [2254f698] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:37,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] spmStart polling ended: taskId = 8b755a2f-22b7-43f5-ae6f-79ecb30981cf task status = finished >2012-12-23 16:06:37,804 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:37,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] spmStart polling ended, spm status: Free >2012-12-23 16:06:37,825 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [2254f698] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8b755a2f-22b7-43f5-ae6f-79ecb30981cf), log id: 393044db >2012-12-23 16:06:37,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [2254f698] FINISH, HSMClearTaskVDSCommand, log id: 393044db >2012-12-23 16:06:37,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [2254f698] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@ff8a332, log id: 4c3d074 >2012-12-23 16:06:37,848 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-65) [ca22fcf] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:06:37,999 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:06:39,634 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:41,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:46,772 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:48,026 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [2b09e308] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:06:48,060 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [2b09e308] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:06:48,061 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4b04b8e9 >2012-12-23 16:06:48,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] spmStart polling started: taskId = f609001e-fb7e-4d82-8602-52b56fbb19fc >2012-12-23 16:06:48,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:51,087 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:53,131 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1d195445] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:55,177 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:57,207 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:06:58,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [2b09e308] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:06:58,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [2b09e308] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:58,357 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] spmStart polling ended: taskId = f609001e-fb7e-4d82-8602-52b56fbb19fc task status = finished >2012-12-23 16:06:58,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:06:58,378 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] spmStart polling ended, spm status: Free >2012-12-23 16:06:58,380 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f609001e-fb7e-4d82-8602-52b56fbb19fc), log id: 7667719d >2012-12-23 16:06:58,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] FINISH, HSMClearTaskVDSCommand, log id: 7667719d >2012-12-23 16:06:58,403 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [2b09e308] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1543726, log id: 4b04b8e9 >2012-12-23 16:06:58,406 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-91) [3ff0a078] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:06:59,106 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3ff0a078] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:06:59,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [86cc0b1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:01,690 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:03,758 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:06,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:08,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:09,135 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:07:09,158 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [462b881a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:07:09,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 19fb6c86 >2012-12-23 16:07:09,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] spmStart polling started: taskId = 1a810a29-3508-4aff-b66a-7d5a5d97723f >2012-12-23 16:07:10,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:12,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:07:14,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:07:16,693 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:18,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [462b881a] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:07:18,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [462b881a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:07:18,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] spmStart polling ended: taskId = 1a810a29-3508-4aff-b66a-7d5a5d97723f task status = finished >2012-12-23 16:07:18,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:07:18,773 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] spmStart polling ended, spm status: Free >2012-12-23 16:07:18,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [462b881a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1a810a29-3508-4aff-b66a-7d5a5d97723f), log id: 5128462f >2012-12-23 16:07:18,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [462b881a] FINISH, HSMClearTaskVDSCommand, log id: 5128462f >2012-12-23 16:07:18,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [462b881a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2b17e149, log id: 19fb6c86 >2012-12-23 16:07:18,797 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [2cc795b9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:07:18,813 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:19,353 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [2cc795b9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:07:21,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:23,634 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:25,999 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:28,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:29,496 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:07:29,509 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [560b2e0f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:07:29,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4daace30 >2012-12-23 16:07:29,535 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] spmStart polling started: taskId = 5ce66f0e-dda3-4de5-bb96-572d028ddf77 >2012-12-23 16:07:30,141 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:32,203 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:34,290 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:36,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:38,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:39,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [560b2e0f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:07:39,787 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [560b2e0f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:07:39,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] spmStart polling ended: taskId = 5ce66f0e-dda3-4de5-bb96-572d028ddf77 task status = finished >2012-12-23 16:07:39,787 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:07:39,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] spmStart polling ended, spm status: Free >2012-12-23 16:07:39,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5ce66f0e-dda3-4de5-bb96-572d028ddf77), log id: 210697ec >2012-12-23 16:07:39,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] FINISH, HSMClearTaskVDSCommand, log id: 210697ec >2012-12-23 16:07:39,826 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [560b2e0f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@37e017e4, log id: 4daace30 >2012-12-23 16:07:39,829 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [59409664] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:07:39,890 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [59409664] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:07:40,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:42,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:44,597 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:46,706 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:49,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:49,917 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:07:49,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:07:49,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5eb0ac7 >2012-12-23 16:07:49,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) spmStart polling started: taskId = a3296d24-27af-4692-b576-cbf260f36e5d >2012-12-23 16:07:51,684 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:53,711 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:55,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [66546d14] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:57,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:07:59,844 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:00,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:08:00,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:00,237 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) spmStart polling ended: taskId = a3296d24-27af-4692-b576-cbf260f36e5d task status = finished >2012-12-23 16:08:00,237 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:00,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) spmStart polling ended, spm status: Free >2012-12-23 16:08:00,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a3296d24-27af-4692-b576-cbf260f36e5d), log id: 19e3869c >2012-12-23 16:08:00,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) FINISH, HSMClearTaskVDSCommand, log id: 19e3869c >2012-12-23 16:08:00,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@289a790b, log id: 5eb0ac7 >2012-12-23 16:08:00,281 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-41) [3580d600] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:08:00,330 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [3580d600] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:08:01,931 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:03,982 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:06,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:08,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:10,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:10,368 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [36f78d01] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:08:10,754 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [36f78d01] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:08:10,756 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1755773d >2012-12-23 16:08:10,780 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] spmStart polling started: taskId = 3a3140d2-c4a0-4e77-9650-64280ce736dc >2012-12-23 16:08:12,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:08:14,896 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:16,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:18,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:20,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [36f78d01] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:08:20,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [36f78d01] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:20,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] spmStart polling ended: taskId = 3a3140d2-c4a0-4e77-9650-64280ce736dc task status = finished >2012-12-23 16:08:20,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:20,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] spmStart polling ended, spm status: Free >2012-12-23 16:08:20,051 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3a3140d2-c4a0-4e77-9650-64280ce736dc), log id: 552bfe9f >2012-12-23 16:08:20,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] FINISH, HSMClearTaskVDSCommand, log id: 552bfe9f >2012-12-23 16:08:20,070 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [36f78d01] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3b59a468, log id: 1755773d >2012-12-23 16:08:20,074 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [7a38c648] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:08:20,108 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:08:21,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:23,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:25,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:27,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:29,272 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:30,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [e0a5f27] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:08:30,149 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [e0a5f27] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:08:30,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6781879e >2012-12-23 16:08:30,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] spmStart polling started: taskId = 0b7f66e7-58f5-40fa-afce-7b0db9f5ba51 >2012-12-23 16:08:31,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:33,365 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:35,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:37,902 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:39,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:41,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [e0a5f27] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:08:41,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [e0a5f27] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:41,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] spmStart polling ended: taskId = 0b7f66e7-58f5-40fa-afce-7b0db9f5ba51 task status = finished >2012-12-23 16:08:41,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:08:41,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] spmStart polling ended, spm status: Free >2012-12-23 16:08:41,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0b7f66e7-58f5-40fa-afce-7b0db9f5ba51), log id: 6e2b5b73 >2012-12-23 16:08:41,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] FINISH, HSMClearTaskVDSCommand, log id: 6e2b5b73 >2012-12-23 16:08:41,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [e0a5f27] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@60811386, log id: 6781879e >2012-12-23 16:08:41,494 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [3a28f3e9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:08:41,558 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3a28f3e9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:08:42,087 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:44,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:46,226 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:48,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [1fab69cd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:50,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:51,584 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [86cc0b1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:08:51,609 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [86cc0b1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:08:51,611 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 434b6f46 >2012-12-23 16:08:51,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] spmStart polling started: taskId = 966d68ef-0a5e-41f1-b172-d188a856ee08 >2012-12-23 16:08:52,370 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:54,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:56,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) [2f410217] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:58,391 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] XML RPC error in command ListVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:08:58,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:08:59,752 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-76) [52db807f] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 16:09:01,937 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:02,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [86cc0b1] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:09:02,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [86cc0b1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:02,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] spmStart polling ended: taskId = 966d68ef-0a5e-41f1-b172-d188a856ee08 task status = finished >2012-12-23 16:09:02,012 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:02,033 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] spmStart polling ended, spm status: Free >2012-12-23 16:09:02,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=966d68ef-0a5e-41f1-b172-d188a856ee08), log id: b05bea1 >2012-12-23 16:09:02,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] FINISH, HSMClearTaskVDSCommand, log id: b05bea1 >2012-12-23 16:09:02,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [86cc0b1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1701e097, log id: 434b6f46 >2012-12-23 16:09:02,178 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [7c3fe54d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:09:02,315 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [7c3fe54d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:09:02,366 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-61) [1b1399b7] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 16:09:02,435 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-61) [5af6ed3d] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:09:02,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-61) [5af6ed3d] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 5c93e866 >2012-12-23 16:09:02,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-61) [5af6ed3d] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 5c93e866 >2012-12-23 16:09:02,463 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-61) [5af6ed3d] Host orchid-vds2 storage connection was succeeded >2012-12-23 16:09:02,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-61) [5af6ed3d] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 685a3775 >2012-12-23 16:09:02,584 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-61) [5af6ed3d] FINISH, ConnectStoragePoolVDSCommand, log id: 685a3775 >2012-12-23 16:09:02,619 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-61) [5af6ed3d] No string for UNASSIGNED type. Use default Log >2012-12-23 16:09:02,621 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) [5af6ed3d] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 16:09:02,641 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-61) [7113feae] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 16:09:02,656 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-61) [5ead9898] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 16:09:04,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:06,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:08,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:10,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:12,349 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [74966471] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:09:12,363 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [74966471] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:09:12,365 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 49ef576a >2012-12-23 16:09:12,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] spmStart polling started: taskId = f0e37152-6d45-41e1-a74d-41849cf738c4 >2012-12-23 16:09:12,876 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:14,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:16,969 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:19,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:21,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [59409664] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:22,632 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [74966471] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:09:22,632 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-92) [74966471] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:22,632 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] spmStart polling ended: taskId = f0e37152-6d45-41e1-a74d-41849cf738c4 task status = finished >2012-12-23 16:09:22,632 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:22,651 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] spmStart polling ended, spm status: Free >2012-12-23 16:09:22,653 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) [74966471] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f0e37152-6d45-41e1-a74d-41849cf738c4), log id: 33ca22e6 >2012-12-23 16:09:22,671 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-92) [74966471] FINISH, HSMClearTaskVDSCommand, log id: 33ca22e6 >2012-12-23 16:09:22,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-92) [74966471] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1bb9449a, log id: 49ef576a >2012-12-23 16:09:22,674 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-92) [2046e8ae] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:09:22,714 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-92) [2046e8ae] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:09:23,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:25,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:27,328 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:29,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:31,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:32,742 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [66546d14] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:09:32,811 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [66546d14] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:09:32,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 221b1193 >2012-12-23 16:09:32,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] spmStart polling started: taskId = 703a1691-3281-47cb-b3b6-954b3a748ce0 >2012-12-23 16:09:33,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:35,881 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:37,962 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:09:40,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:42,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:09:43,110 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [66546d14] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:09:43,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [66546d14] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:43,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] spmStart polling ended: taskId = 703a1691-3281-47cb-b3b6-954b3a748ce0 task status = finished >2012-12-23 16:09:43,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:09:43,129 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] spmStart polling ended, spm status: Free >2012-12-23 16:09:43,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [66546d14] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=703a1691-3281-47cb-b3b6-954b3a748ce0), log id: 3091f40f >2012-12-23 16:09:43,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [66546d14] FINISH, HSMClearTaskVDSCommand, log id: 3091f40f >2012-12-23 16:09:43,149 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [66546d14] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3e2e1db2, log id: 221b1193 >2012-12-23 16:09:43,151 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [459fb102] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:09:43,196 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [459fb102] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:09:44,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:46,333 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:48,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:51,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:53,341 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:55,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:56,204 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:09:56,239 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [4e518f73] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:09:56,243 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2278fd9 >2012-12-23 16:09:56,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] spmStart polling started: taskId = 62a56f66-7f2f-4916-a2d7-072e29278d1b >2012-12-23 16:09:57,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:09:59,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [38663b8e] Checking autorecoverable hosts >2012-12-23 16:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [38663b8e] Autorecovering 0 hosts >2012-12-23 16:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [38663b8e] Checking autorecoverable hosts done >2012-12-23 16:10:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-50) [38663b8e] Autorecovering storage domains is disabled, skipping >2012-12-23 16:10:01,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:03,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:03,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [4e518f73] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:10:03,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [4e518f73] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:03,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] spmStart polling ended: taskId = 62a56f66-7f2f-4916-a2d7-072e29278d1b task status = finished >2012-12-23 16:10:03,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:03,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] spmStart polling ended, spm status: Free >2012-12-23 16:10:03,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=62a56f66-7f2f-4916-a2d7-072e29278d1b), log id: 20f89c12 >2012-12-23 16:10:03,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] FINISH, HSMClearTaskVDSCommand, log id: 20f89c12 >2012-12-23 16:10:03,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [4e518f73] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@21ce72a7, log id: 2278fd9 >2012-12-23 16:10:03,831 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-94) [78c94347] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:10:04,157 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [78c94347] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:10:06,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:08,043 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:10,093 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:12,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-59) [2f410217] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:14,184 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:10:14,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:14,387 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) [52db807f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:10:14,391 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: d93fc93 >2012-12-23 16:10:14,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] spmStart polling started: taskId = e748fc0b-7803-4533-9650-e6346ce07499 >2012-12-23 16:10:16,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [5ead9898] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:18,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:21,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:23,220 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [2cc795b9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:23,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) [52db807f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:10:23,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-76) [52db807f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:23,655 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] spmStart polling ended: taskId = e748fc0b-7803-4533-9650-e6346ce07499 task status = finished >2012-12-23 16:10:23,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:23,678 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] spmStart polling ended, spm status: Free >2012-12-23 16:10:23,679 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-76) [52db807f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e748fc0b-7803-4533-9650-e6346ce07499), log id: 4d568a5b >2012-12-23 16:10:23,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-76) [52db807f] FINISH, HSMClearTaskVDSCommand, log id: 4d568a5b >2012-12-23 16:10:23,701 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-76) [52db807f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6c958407, log id: d93fc93 >2012-12-23 16:10:23,704 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-76) [4c0f1f42] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:10:24,319 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-76) [4c0f1f42] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:10:25,259 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:27,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:29,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:31,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:33,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:34,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:10:34,435 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [2b28f97e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:10:34,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1b43f126 >2012-12-23 16:10:34,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] spmStart polling started: taskId = 865afd20-1294-4021-bff0-051f4d202076 >2012-12-23 16:10:35,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [59409664] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:38,735 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:40,780 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:42,912 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:44,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [2b28f97e] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:10:44,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-51) [2b28f97e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:44,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] spmStart polling ended: taskId = 865afd20-1294-4021-bff0-051f4d202076 task status = finished >2012-12-23 16:10:44,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:10:44,717 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] spmStart polling ended, spm status: Free >2012-12-23 16:10:44,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=865afd20-1294-4021-bff0-051f4d202076), log id: 17238d9a >2012-12-23 16:10:44,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] FINISH, HSMClearTaskVDSCommand, log id: 17238d9a >2012-12-23 16:10:44,744 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-51) [2b28f97e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f258554, log id: 1b43f126 >2012-12-23 16:10:44,748 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-51) [58545dc5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:10:44,957 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-51) [58545dc5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:10:44,982 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:47,060 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:49,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:51,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:53,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:54,984 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:10:54,997 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [164f3d32] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:10:54,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7eaeef98 >2012-12-23 16:10:55,021 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] spmStart polling started: taskId = 3bff6ce7-edcb-4436-ba3b-2bc73dc57e5a >2012-12-23 16:10:55,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [459fb102] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:57,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) [3323983b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:10:59,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:01,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:03,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:05,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) [164f3d32] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:11:05,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-82) [164f3d32] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:05,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] spmStart polling ended: taskId = 3bff6ce7-edcb-4436-ba3b-2bc73dc57e5a task status = finished >2012-12-23 16:11:05,283 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:05,308 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] spmStart polling ended, spm status: Free >2012-12-23 16:11:05,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3bff6ce7-edcb-4436-ba3b-2bc73dc57e5a), log id: 42c6c399 >2012-12-23 16:11:05,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] FINISH, HSMClearTaskVDSCommand, log id: 42c6c399 >2012-12-23 16:11:05,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-82) [164f3d32] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@753940f, log id: 7eaeef98 >2012-12-23 16:11:05,342 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-82) [1d688b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:11:05,383 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-82) [1d688b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:11:06,083 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:08,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:10,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:12,539 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:14,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:15,412 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:11:15,440 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [3abf745a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:11:15,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6d09f40c >2012-12-23 16:11:15,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] spmStart polling started: taskId = f39dfe5a-c431-42e4-8b93-7aa14bb58ec9 >2012-12-23 16:11:16,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:19,861 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1d195445] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:21,914 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:38,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [3abf745a] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:11:38,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-79) [3abf745a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:38,801 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] spmStart polling ended: taskId = f39dfe5a-c431-42e4-8b93-7aa14bb58ec9 task status = finished >2012-12-23 16:11:38,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:38,822 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] spmStart polling ended, spm status: Free >2012-12-23 16:11:38,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f39dfe5a-c431-42e4-8b93-7aa14bb58ec9), log id: b91a65a >2012-12-23 16:11:38,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] FINISH, HSMClearTaskVDSCommand, log id: b91a65a >2012-12-23 16:11:38,845 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-79) [3abf745a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@74064a5, log id: 6d09f40c >2012-12-23 16:11:38,848 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-79) [148f905b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:11:38,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:39,056 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-79) [148f905b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:11:41,066 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [7c3fe54d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:43,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:45,141 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:47,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [4c0f1f42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:49,094 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:11:49,144 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [3adaf394] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:11:49,145 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: edf37f7 >2012-12-23 16:11:49,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] spmStart polling started: taskId = 8c2c45aa-9787-4851-ad09-084da9b839fa >2012-12-23 16:11:49,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:50,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [3adaf394] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:11:50,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-35) [3adaf394] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:50,194 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] spmStart polling ended: taskId = 8c2c45aa-9787-4851-ad09-084da9b839fa task status = finished >2012-12-23 16:11:50,194 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:11:50,213 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] spmStart polling ended, spm status: Free >2012-12-23 16:11:50,215 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8c2c45aa-9787-4851-ad09-084da9b839fa), log id: 304608dc >2012-12-23 16:11:50,234 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] FINISH, HSMClearTaskVDSCommand, log id: 304608dc >2012-12-23 16:11:50,235 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-35) [3adaf394] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7e31bb88, log id: edf37f7 >2012-12-23 16:11:50,237 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-35) [730f1e71] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:11:50,297 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-35) [730f1e71] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:11:51,272 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:53,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:55,385 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:57,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:11:59,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:00,324 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [59409664] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:12:00,766 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [59409664] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:12:00,768 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2ba708ec >2012-12-23 16:12:00,791 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] spmStart polling started: taskId = d50ca7cc-3a48-4f69-83b9-8771af71844f >2012-12-23 16:12:01,983 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:04,039 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:04,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [59409664] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:12:04,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [59409664] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:04,899 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] spmStart polling ended: taskId = d50ca7cc-3a48-4f69-83b9-8771af71844f task status = finished >2012-12-23 16:12:04,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:04,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] spmStart polling ended, spm status: Free >2012-12-23 16:12:04,918 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [59409664] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d50ca7cc-3a48-4f69-83b9-8771af71844f), log id: 2d9e54b9 >2012-12-23 16:12:04,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [59409664] FINISH, HSMClearTaskVDSCommand, log id: 2d9e54b9 >2012-12-23 16:12:04,938 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [59409664] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75cc5514, log id: 2ba708ec >2012-12-23 16:12:04,939 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [39e5d077] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:12:04,991 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [39e5d077] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:12:06,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:08,300 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:11,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:13,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:15,018 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [3580d600] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:12:15,034 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [3580d600] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:12:15,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 43e1bdac >2012-12-23 16:12:15,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] spmStart polling started: taskId = 68342c4f-313f-4cbb-992d-28dc19c91824 >2012-12-23 16:12:15,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:17,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:19,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:21,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:23,710 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:25,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3580d600] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:12:25,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [3580d600] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:25,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] spmStart polling ended: taskId = 68342c4f-313f-4cbb-992d-28dc19c91824 task status = finished >2012-12-23 16:12:25,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:25,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] spmStart polling ended, spm status: Free >2012-12-23 16:12:25,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [3580d600] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=68342c4f-313f-4cbb-992d-28dc19c91824), log id: 22759ff >2012-12-23 16:12:25,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [3580d600] FINISH, HSMClearTaskVDSCommand, log id: 22759ff >2012-12-23 16:12:25,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [3580d600] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@65857573, log id: 43e1bdac >2012-12-23 16:12:25,347 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-41) [1ce20517] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:12:25,377 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [1ce20517] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:12:25,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:28,023 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:30,078 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [1d688b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:32,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [6da288f9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:34,164 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:35,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:12:35,417 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [34a38b53] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:12:35,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 31886573 >2012-12-23 16:12:35,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] spmStart polling started: taskId = 9d0df830-8b24-4903-9397-498148ac4912 >2012-12-23 16:12:36,213 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:38,248 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [3a28f3e9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:40,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [78c94347] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:42,369 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:44,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:46,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:12:46,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [34a38b53] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:12:46,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [34a38b53] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:46,722 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] spmStart polling ended: taskId = 9d0df830-8b24-4903-9397-498148ac4912 task status = finished >2012-12-23 16:12:46,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:12:46,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] spmStart polling ended, spm status: Free >2012-12-23 16:12:46,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9d0df830-8b24-4903-9397-498148ac4912), log id: 4511f770 >2012-12-23 16:12:46,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] FINISH, HSMClearTaskVDSCommand, log id: 4511f770 >2012-12-23 16:12:46,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [34a38b53] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1e8bfd7d, log id: 31886573 >2012-12-23 16:12:46,765 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-2) [78af2935] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:12:47,660 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:12:48,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:50,852 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:53,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [5ead9898] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:56,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:12:57,687 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:12:57,781 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [1a8d41e7] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:12:57,783 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 651c187b >2012-12-23 16:12:57,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] spmStart polling started: taskId = 3ddd0eb9-3448-47cb-a020-c2c2372271a2 >2012-12-23 16:12:58,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:00,332 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [4c0f1f42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:02,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [730f1e71] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:04,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:06,853 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:07,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [1a8d41e7] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:13:07,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-18) [1a8d41e7] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:07,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] spmStart polling ended: taskId = 3ddd0eb9-3448-47cb-a020-c2c2372271a2 task status = finished >2012-12-23 16:13:07,304 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:07,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] spmStart polling ended, spm status: Free >2012-12-23 16:13:07,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3ddd0eb9-3448-47cb-a020-c2c2372271a2), log id: 2302da33 >2012-12-23 16:13:07,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] FINISH, HSMClearTaskVDSCommand, log id: 2302da33 >2012-12-23 16:13:07,348 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-18) [1a8d41e7] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@10435c3a, log id: 651c187b >2012-12-23 16:13:07,350 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-18) [365bec2d] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:13:07,418 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-18) [365bec2d] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:13:08,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:11,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:13,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:16,241 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:17,447 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:13:17,465 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:13:17,467 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1a013ff9 >2012-12-23 16:13:17,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) spmStart polling started: taskId = 7aa1ef6d-8166-43aa-b161-0e6e707b0210 >2012-12-23 16:13:18,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:20,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:23,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:25,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [295f87f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:27,718 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:13:27,718 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:27,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) spmStart polling ended: taskId = 7aa1ef6d-8166-43aa-b161-0e6e707b0210 task status = finished >2012-12-23 16:13:27,718 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:27,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) spmStart polling ended, spm status: Free >2012-12-23 16:13:27,743 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-43) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7aa1ef6d-8166-43aa-b161-0e6e707b0210), log id: 3138c922 >2012-12-23 16:13:27,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-43) FINISH, HSMClearTaskVDSCommand, log id: 3138c922 >2012-12-23 16:13:27,763 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@71cf06d, log id: 1a013ff9 >2012-12-23 16:13:27,765 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-43) [7cec87c0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:13:27,794 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [7cec87c0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:13:28,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:13:37,821 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:13:37,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [1a003033] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:13:37,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4658b10 >2012-12-23 16:13:37,879 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] spmStart polling started: taskId = 98053dd1-ba38-446a-b3ed-2e496d94ecb2 >2012-12-23 16:13:48,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [1a003033] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:13:48,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-98) [1a003033] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:48,120 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] spmStart polling ended: taskId = 98053dd1-ba38-446a-b3ed-2e496d94ecb2 task status = finished >2012-12-23 16:13:48,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:13:48,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] spmStart polling ended, spm status: Free >2012-12-23 16:13:48,141 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [1a003033] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=98053dd1-ba38-446a-b3ed-2e496d94ecb2), log id: 78c831e2 >2012-12-23 16:13:48,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-98) [1a003033] FINISH, HSMClearTaskVDSCommand, log id: 78c831e2 >2012-12-23 16:13:48,160 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-98) [1a003033] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f432a61, log id: 4658b10 >2012-12-23 16:13:48,162 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-98) [7293564f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:13:48,201 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-98) [7293564f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:13:58,228 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:13:58,254 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:13:58,256 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 28b6ac87 >2012-12-23 16:13:58,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) spmStart polling started: taskId = 48a36ff6-6612-431e-9784-41d701af82c6 >2012-12-23 16:14:08,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:14:08,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:08,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) spmStart polling ended: taskId = 48a36ff6-6612-431e-9784-41d701af82c6 task status = finished >2012-12-23 16:14:08,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:08,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) spmStart polling ended, spm status: Free >2012-12-23 16:14:08,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=48a36ff6-6612-431e-9784-41d701af82c6), log id: 39bbf9f1 >2012-12-23 16:14:08,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) FINISH, HSMClearTaskVDSCommand, log id: 39bbf9f1 >2012-12-23 16:14:08,750 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@64165ad3, log id: 28b6ac87 >2012-12-23 16:14:08,753 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-96) [77a505fa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:14:09,095 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [77a505fa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:14:19,714 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:14:19,740 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:14:19,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 47c7401d >2012-12-23 16:14:19,766 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) spmStart polling started: taskId = 2ab34a6e-2eb6-408b-aaee-c396df73409c >2012-12-23 16:14:30,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:14:30,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:30,004 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) spmStart polling ended: taskId = 2ab34a6e-2eb6-408b-aaee-c396df73409c task status = finished >2012-12-23 16:14:30,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:30,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) spmStart polling ended, spm status: Free >2012-12-23 16:14:30,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=2ab34a6e-2eb6-408b-aaee-c396df73409c), log id: 5f275ab8 >2012-12-23 16:14:30,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) FINISH, HSMClearTaskVDSCommand, log id: 5f275ab8 >2012-12-23 16:14:30,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@10b516d6, log id: 47c7401d >2012-12-23 16:14:30,051 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-19) [60ee442b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:14:30,094 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [60ee442b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:14:40,125 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:14:41,345 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [36778af4] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:14:41,347 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6652f909 >2012-12-23 16:14:41,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] spmStart polling started: taskId = 5cf7a307-43df-40a8-b12b-f783f0b5edb3 >2012-12-23 16:14:50,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [36778af4] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:14:50,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-33) [36778af4] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:50,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] spmStart polling ended: taskId = 5cf7a307-43df-40a8-b12b-f783f0b5edb3 task status = finished >2012-12-23 16:14:50,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:14:50,626 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] spmStart polling ended, spm status: Free >2012-12-23 16:14:50,628 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [36778af4] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5cf7a307-43df-40a8-b12b-f783f0b5edb3), log id: 7f45ad9c >2012-12-23 16:14:50,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-33) [36778af4] FINISH, HSMClearTaskVDSCommand, log id: 7f45ad9c >2012-12-23 16:14:50,650 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-33) [36778af4] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@37891e0b, log id: 6652f909 >2012-12-23 16:14:50,652 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-33) [b1380a9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:14:50,973 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-33) [b1380a9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [542bc6ff] Checking autorecoverable hosts >2012-12-23 16:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [542bc6ff] Autorecovering 0 hosts >2012-12-23 16:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [542bc6ff] Checking autorecoverable hosts done >2012-12-23 16:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-64) [542bc6ff] Autorecovering storage domains is disabled, skipping >2012-12-23 16:15:00,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:15:01,306 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [49f3c5ee] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:15:01,308 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3903738 >2012-12-23 16:15:01,331 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] spmStart polling started: taskId = 87bb8519-814f-43ff-805e-47902a719afe >2012-12-23 16:15:10,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [49f3c5ee] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:15:10,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [49f3c5ee] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:10,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] spmStart polling ended: taskId = 87bb8519-814f-43ff-805e-47902a719afe task status = finished >2012-12-23 16:15:10,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:10,587 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] spmStart polling ended, spm status: Free >2012-12-23 16:15:10,589 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=87bb8519-814f-43ff-805e-47902a719afe), log id: 31f03b6a >2012-12-23 16:15:10,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] FINISH, HSMClearTaskVDSCommand, log id: 31f03b6a >2012-12-23 16:15:10,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [49f3c5ee] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3882f2a2, log id: 3903738 >2012-12-23 16:15:10,626 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-81) [1d0786aa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:15:11,844 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [1d0786aa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:15:21,870 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:15:22,104 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [62f4b2bc] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:15:22,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3e2f80c7 >2012-12-23 16:15:22,130 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] spmStart polling started: taskId = 4825d2fb-4846-46b7-8b98-a495de285709 >2012-12-23 16:15:31,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [62f4b2bc] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:15:31,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-46) [62f4b2bc] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:31,326 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] spmStart polling ended: taskId = 4825d2fb-4846-46b7-8b98-a495de285709 task status = finished >2012-12-23 16:15:31,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:31,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] spmStart polling ended, spm status: Free >2012-12-23 16:15:31,346 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4825d2fb-4846-46b7-8b98-a495de285709), log id: a2f11c1 >2012-12-23 16:15:31,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] FINISH, HSMClearTaskVDSCommand, log id: a2f11c1 >2012-12-23 16:15:31,364 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-46) [62f4b2bc] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@18369b20, log id: 3e2f80c7 >2012-12-23 16:15:31,367 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-46) [29025e4b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:15:31,954 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-46) [29025e4b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:15:41,982 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [1ce20517] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:15:42,162 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [1ce20517] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:15:42,164 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 158b63ac >2012-12-23 16:15:42,186 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] spmStart polling started: taskId = d08c99b7-fea0-4ab3-be6a-d9406e736abf >2012-12-23 16:15:52,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [1ce20517] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:15:52,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [1ce20517] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:52,419 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] spmStart polling ended: taskId = d08c99b7-fea0-4ab3-be6a-d9406e736abf task status = finished >2012-12-23 16:15:52,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:15:52,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] spmStart polling ended, spm status: Free >2012-12-23 16:15:52,442 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d08c99b7-fea0-4ab3-be6a-d9406e736abf), log id: 4c5670f6 >2012-12-23 16:15:52,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] FINISH, HSMClearTaskVDSCommand, log id: 4c5670f6 >2012-12-23 16:15:52,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [1ce20517] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3f124da1, log id: 158b63ac >2012-12-23 16:15:52,465 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-41) [4aa6a560] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:15:52,780 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [4aa6a560] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:16:02,810 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3a28f3e9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:16:02,947 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [3a28f3e9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:16:02,952 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 17ccc87d >2012-12-23 16:16:02,978 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] spmStart polling started: taskId = 3edb7104-4316-4672-885d-0fe33cef4ca6 >2012-12-23 16:16:12,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [3a28f3e9] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:16:12,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [3a28f3e9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:12,558 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] spmStart polling ended: taskId = 3edb7104-4316-4672-885d-0fe33cef4ca6 task status = finished >2012-12-23 16:16:12,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:12,577 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] spmStart polling ended, spm status: Free >2012-12-23 16:16:12,578 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3edb7104-4316-4672-885d-0fe33cef4ca6), log id: 3ed82f55 >2012-12-23 16:16:12,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] FINISH, HSMClearTaskVDSCommand, log id: 3ed82f55 >2012-12-23 16:16:12,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [3a28f3e9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@630b95ae, log id: 17ccc87d >2012-12-23 16:16:12,604 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [d90054f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:16:12,960 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [d90054f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:16:22,985 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3ff0a078] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:16:23,004 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [3ff0a078] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:16:23,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7853d921 >2012-12-23 16:16:23,030 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] spmStart polling started: taskId = 65462293-4616-405f-b08a-febeda0384ce >2012-12-23 16:16:30,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:16:33,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [3ff0a078] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:16:33,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-91) [3ff0a078] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:33,257 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] spmStart polling ended: taskId = 65462293-4616-405f-b08a-febeda0384ce task status = finished >2012-12-23 16:16:33,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:33,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] spmStart polling ended, spm status: Free >2012-12-23 16:16:33,280 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=65462293-4616-405f-b08a-febeda0384ce), log id: 35da0e6b >2012-12-23 16:16:33,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] FINISH, HSMClearTaskVDSCommand, log id: 35da0e6b >2012-12-23 16:16:33,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-91) [3ff0a078] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7ee8ae6b, log id: 7853d921 >2012-12-23 16:16:33,303 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-91) [5e1333e4] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:16:33,355 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-91) [5e1333e4] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:16:34,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:36,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:38,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:40,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:42,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:43,383 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:16:44,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [6dc93b50] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:16:44,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 71333da8 >2012-12-23 16:16:44,062 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] spmStart polling started: taskId = 0ca04e1b-3826-4d3b-9dda-e4f096e586d8 >2012-12-23 16:16:44,641 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:46,965 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:49,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:51,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:53,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [6dc93b50] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:16:53,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [6dc93b50] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:53,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] spmStart polling ended: taskId = 0ca04e1b-3826-4d3b-9dda-e4f096e586d8 task status = finished >2012-12-23 16:16:53,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:16:53,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] spmStart polling ended, spm status: Free >2012-12-23 16:16:53,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0ca04e1b-3826-4d3b-9dda-e4f096e586d8), log id: 4337fd9e >2012-12-23 16:16:53,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] FINISH, HSMClearTaskVDSCommand, log id: 4337fd9e >2012-12-23 16:16:53,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [6dc93b50] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@10ebb28c, log id: 71333da8 >2012-12-23 16:16:53,304 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-62) [62170e01] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:16:53,379 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [62170e01] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:16:53,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:56,004 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:16:58,157 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:00,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:03,406 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:17:03,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) [7cec87c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:03,681 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [21a14b18] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:17:03,683 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6fb8acc2 >2012-12-23 16:17:03,705 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] spmStart polling started: taskId = 09d09c1b-32de-4d68-a0b3-bc1653a66c3b >2012-12-23 16:17:06,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:08,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:10,243 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:12,286 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:12,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [21a14b18] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:17:12,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-47) [21a14b18] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:12,948 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] spmStart polling ended: taskId = 09d09c1b-32de-4d68-a0b3-bc1653a66c3b task status = finished >2012-12-23 16:17:12,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:12,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] spmStart polling ended, spm status: Free >2012-12-23 16:17:12,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=09d09c1b-32de-4d68-a0b3-bc1653a66c3b), log id: 1e27bd15 >2012-12-23 16:17:12,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] FINISH, HSMClearTaskVDSCommand, log id: 1e27bd15 >2012-12-23 16:17:12,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-47) [21a14b18] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@42eebd2a, log id: 6fb8acc2 >2012-12-23 16:17:12,990 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-47) [47c532ba] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:17:13,116 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-47) [47c532ba] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:17:14,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:16,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-98) [7293564f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:18,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-87) [3d4c3194] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:20,893 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-41) [4aa6a560] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:22,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:23,178 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:17:23,215 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [554cca02] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:17:23,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 137328ed >2012-12-23 16:17:23,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] spmStart polling started: taskId = 23fa3f71-d047-4620-8e3f-a4344e4d1bfe >2012-12-23 16:17:25,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:27,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:29,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) [77a505fa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:31,321 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:33,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [d90054f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:33,523 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [554cca02] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:17:33,523 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-74) [554cca02] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:33,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] spmStart polling ended: taskId = 23fa3f71-d047-4620-8e3f-a4344e4d1bfe task status = finished >2012-12-23 16:17:33,523 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:33,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] spmStart polling ended, spm status: Free >2012-12-23 16:17:33,543 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [554cca02] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=23fa3f71-d047-4620-8e3f-a4344e4d1bfe), log id: 2340ba34 >2012-12-23 16:17:33,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-74) [554cca02] FINISH, HSMClearTaskVDSCommand, log id: 2340ba34 >2012-12-23 16:17:33,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-74) [554cca02] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6e80be00, log id: 137328ed >2012-12-23 16:17:33,565 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-74) [463a2aad] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:17:34,347 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-74) [463a2aad] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:17:36,136 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:38,214 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:40,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:42,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [60ee442b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:44,372 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [7c3fe54d] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:17:44,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [5ead9898] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:44,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [7c3fe54d] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:17:44,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 10f12374 >2012-12-23 16:17:44,413 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] spmStart polling started: taskId = 418c157e-16e7-4a10-82ab-c8839c3b110f >2012-12-23 16:17:46,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:48,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:51,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:53,298 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:54,663 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [7c3fe54d] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:17:54,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [7c3fe54d] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:54,664 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] spmStart polling ended: taskId = 418c157e-16e7-4a10-82ab-c8839c3b110f task status = finished >2012-12-23 16:17:54,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:17:54,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] spmStart polling ended, spm status: Free >2012-12-23 16:17:54,686 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=418c157e-16e7-4a10-82ab-c8839c3b110f), log id: 76e45ef2 >2012-12-23 16:17:54,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] FINISH, HSMClearTaskVDSCommand, log id: 76e45ef2 >2012-12-23 16:17:54,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [7c3fe54d] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@b159ed9, log id: 10f12374 >2012-12-23 16:17:54,706 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [386fbe3e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:17:54,770 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:17:55,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:57,427 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:17:59,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:01,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:03,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:04,799 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:18:04,812 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [52cf9606] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:18:04,814 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 33565554 >2012-12-23 16:18:04,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] spmStart polling started: taskId = 600349cb-0fe0-4c6a-9795-04c045e08910 >2012-12-23 16:18:06,644 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:08,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:11,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:13,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:15,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [52cf9606] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:18:15,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-55) [52cf9606] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:15,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] spmStart polling ended: taskId = 600349cb-0fe0-4c6a-9795-04c045e08910 task status = finished >2012-12-23 16:18:15,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:15,098 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] spmStart polling ended, spm status: Free >2012-12-23 16:18:15,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=600349cb-0fe0-4c6a-9795-04c045e08910), log id: 2fa2441 >2012-12-23 16:18:15,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] FINISH, HSMClearTaskVDSCommand, log id: 2fa2441 >2012-12-23 16:18:15,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-55) [52cf9606] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@746228ed, log id: 33565554 >2012-12-23 16:18:15,122 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-55) [586d1b4c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:18:15,227 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-55) [586d1b4c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:18:15,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [295f87f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:17,363 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:19,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:21,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:23,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-24) [459fb102] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:25,253 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [3323983b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:18:25,268 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [3323983b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:18:25,270 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 72cdf096 >2012-12-23 16:18:25,291 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] spmStart polling started: taskId = f9edb54b-36cd-4bc0-a06f-4cdc5ed15472 >2012-12-23 16:18:25,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [47c532ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:28,020 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:30,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:32,351 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [1d688b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:34,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:35,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [3323983b] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:18:35,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-9) [3323983b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:35,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] spmStart polling ended: taskId = f9edb54b-36cd-4bc0-a06f-4cdc5ed15472 task status = finished >2012-12-23 16:18:35,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:35,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] spmStart polling ended, spm status: Free >2012-12-23 16:18:35,574 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-9) [3323983b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f9edb54b-36cd-4bc0-a06f-4cdc5ed15472), log id: 49563b3e >2012-12-23 16:18:35,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-9) [3323983b] FINISH, HSMClearTaskVDSCommand, log id: 49563b3e >2012-12-23 16:18:35,593 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-9) [3323983b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3c4b890f, log id: 72cdf096 >2012-12-23 16:18:35,595 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-9) [31356b6] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:18:35,615 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-9) [31356b6] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:18:36,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:38,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:41,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:43,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [78c94347] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:45,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:45,641 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [d90054f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:18:45,660 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [d90054f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:18:45,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3f65d3a3 >2012-12-23 16:18:45,684 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] spmStart polling started: taskId = c1c3946b-6af4-424d-8166-f1024fe5bc25 >2012-12-23 16:18:47,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:49,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:51,254 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:53,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:55,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:55,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [d90054f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:18:55,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-32) [d90054f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:55,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] spmStart polling ended: taskId = c1c3946b-6af4-424d-8166-f1024fe5bc25 task status = finished >2012-12-23 16:18:55,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:18:55,943 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] spmStart polling ended, spm status: Free >2012-12-23 16:18:55,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [d90054f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c1c3946b-6af4-424d-8166-f1024fe5bc25), log id: 284291bc >2012-12-23 16:18:55,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-32) [d90054f] FINISH, HSMClearTaskVDSCommand, log id: 284291bc >2012-12-23 16:18:55,963 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-32) [d90054f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2a6de24a, log id: 3f65d3a3 >2012-12-23 16:18:55,965 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-32) [14237e09] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:18:56,019 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-32) [14237e09] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:18:57,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:18:59,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:02,003 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-71) [79368e4f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:04,049 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:06,045 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:19:06,076 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [129d1e7e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:19:06,077 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1b439f49 >2012-12-23 16:19:06,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] spmStart polling started: taskId = 711c553f-7f37-42dc-9882-cfeab1afa3ea >2012-12-23 16:19:06,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [730f1e71] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:08,381 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:11,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:13,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:19:16,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [129d1e7e] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:19:16,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [129d1e7e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:16,324 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] spmStart polling ended: taskId = 711c553f-7f37-42dc-9882-cfeab1afa3ea task status = finished >2012-12-23 16:19:16,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:16,343 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] spmStart polling ended, spm status: Free >2012-12-23 16:19:16,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=711c553f-7f37-42dc-9882-cfeab1afa3ea), log id: 37ecb6d3 >2012-12-23 16:19:16,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] FINISH, HSMClearTaskVDSCommand, log id: 37ecb6d3 >2012-12-23 16:19:16,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [129d1e7e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@15d6f354, log id: 1b439f49 >2012-12-23 16:19:16,365 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [53011aff] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:19:16,483 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [53011aff] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:19:16,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-64) [542bc6ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:18,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:21,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [62170e01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:23,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:25,535 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:26,508 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:19:26,519 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [15f2d308] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:19:26,523 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1dea0b78 >2012-12-23 16:19:26,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] spmStart polling started: taskId = 99f88737-113d-4a7d-aad5-8f96600dc6be >2012-12-23 16:19:27,568 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:29,621 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:31,657 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:33,689 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:36,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [29025e4b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:37,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [15f2d308] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:19:37,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [15f2d308] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:37,901 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] spmStart polling ended: taskId = 99f88737-113d-4a7d-aad5-8f96600dc6be task status = finished >2012-12-23 16:19:37,901 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:37,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] spmStart polling ended, spm status: Free >2012-12-23 16:19:37,920 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=99f88737-113d-4a7d-aad5-8f96600dc6be), log id: 115245a8 >2012-12-23 16:19:37,939 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] FINISH, HSMClearTaskVDSCommand, log id: 115245a8 >2012-12-23 16:19:37,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [15f2d308] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@305b217a, log id: 1dea0b78 >2012-12-23 16:19:37,944 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-37) [2ef2e963] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:19:38,030 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [2ef2e963] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:19:38,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:40,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:42,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:44,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:46,556 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-82) [1d688b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:48,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [6da288f9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:19:48,079 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [6da288f9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:19:48,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2a32edd2 >2012-12-23 16:19:48,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] spmStart polling started: taskId = 79f5f319-2c14-47e7-87e2-fcdba24847da >2012-12-23 16:19:48,614 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) [31356b6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:51,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:53,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:19:55,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:57,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:58,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [6da288f9] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:19:58,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [6da288f9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:58,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] spmStart polling ended: taskId = 79f5f319-2c14-47e7-87e2-fcdba24847da task status = finished >2012-12-23 16:19:58,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:19:58,363 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] spmStart polling ended, spm status: Free >2012-12-23 16:19:58,365 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=79f5f319-2c14-47e7-87e2-fcdba24847da), log id: b1487f7 >2012-12-23 16:19:58,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] FINISH, HSMClearTaskVDSCommand, log id: b1487f7 >2012-12-23 16:19:58,384 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [6da288f9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@70ea6ecf, log id: 2a32edd2 >2012-12-23 16:19:58,386 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-23) [2f1111f3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:19:59,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:19:59,550 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [2f1111f3] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1d195445] Checking autorecoverable hosts >2012-12-23 16:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1d195445] Autorecovering 0 hosts >2012-12-23 16:20:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1d195445] Checking autorecoverable hosts done >2012-12-23 16:20:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-7) [1d195445] Autorecovering storage domains is disabled, skipping >2012-12-23 16:20:01,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:04,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:06,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:08,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [148f905b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:09,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [60ee442b] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:20:09,680 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [60ee442b] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:20:09,681 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5029d2cc >2012-12-23 16:20:09,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] spmStart polling started: taskId = 63fc5fda-5ae5-4182-b4ed-bfe581dbbfe6 >2012-12-23 16:20:10,376 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [14237e09] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:12,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:14,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:16,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [2cc795b9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:18,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:19,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) [60ee442b] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:20:19,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) [60ee442b] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:19,139 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] spmStart polling ended: taskId = 63fc5fda-5ae5-4182-b4ed-bfe581dbbfe6 task status = finished >2012-12-23 16:20:19,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:19,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] spmStart polling ended, spm status: Free >2012-12-23 16:20:19,159 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=63fc5fda-5ae5-4182-b4ed-bfe581dbbfe6), log id: 5e8881db >2012-12-23 16:20:19,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] FINISH, HSMClearTaskVDSCommand, log id: 5e8881db >2012-12-23 16:20:19,178 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [60ee442b] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@54058159, log id: 5029d2cc >2012-12-23 16:20:19,180 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-19) [356f2527] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:20:19,598 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [356f2527] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:20:20,621 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:22,675 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:24,731 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:26,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:28,796 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:29,688 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [53011aff] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:20:29,719 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [53011aff] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:20:29,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5f78dea2 >2012-12-23 16:20:29,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] spmStart polling started: taskId = 1aa85b63-6f3f-4cbd-9e74-4d48ce5d7bac >2012-12-23 16:20:31,228 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:33,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:35,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-62) [62170e01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:37,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [1d0786aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:38,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [53011aff] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:20:38,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [53011aff] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:38,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] spmStart polling ended: taskId = 1aa85b63-6f3f-4cbd-9e74-4d48ce5d7bac task status = finished >2012-12-23 16:20:38,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:38,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] spmStart polling ended, spm status: Free >2012-12-23 16:20:38,979 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [53011aff] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1aa85b63-6f3f-4cbd-9e74-4d48ce5d7bac), log id: 3c76bfbe >2012-12-23 16:20:38,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [53011aff] FINISH, HSMClearTaskVDSCommand, log id: 3c76bfbe >2012-12-23 16:20:38,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [53011aff] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@182671f5, log id: 5f78dea2 >2012-12-23 16:20:38,999 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [4039836] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:20:39,238 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [4039836] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:20:39,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [58545dc5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:41,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-55) [586d1b4c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:43,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:46,068 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:48,381 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:49,264 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [2ef2e963] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:20:49,301 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [2ef2e963] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:20:49,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 46922066 >2012-12-23 16:20:49,325 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] spmStart polling started: taskId = 06a54169-2281-4405-b8b5-685261367789 >2012-12-23 16:20:50,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:52,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:54,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:56,585 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:58,631 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:20:59,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [2ef2e963] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:20:59,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-37) [2ef2e963] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:59,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] spmStart polling ended: taskId = 06a54169-2281-4405-b8b5-685261367789 task status = finished >2012-12-23 16:20:59,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:20:59,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] spmStart polling ended, spm status: Free >2012-12-23 16:20:59,586 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=06a54169-2281-4405-b8b5-685261367789), log id: 1d6eec19 >2012-12-23 16:20:59,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] FINISH, HSMClearTaskVDSCommand, log id: 1d6eec19 >2012-12-23 16:20:59,605 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-37) [2ef2e963] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5d4e6c67, log id: 46922066 >2012-12-23 16:20:59,606 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-37) [47af0e0c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:20:59,654 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-37) [47af0e0c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:21:01,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-56) [4ccf86fe] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:03,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-9) [31356b6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:05,396 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-3) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:07,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:09,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:09,691 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [78c94347] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:21:10,035 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [78c94347] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:21:10,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 68b961a1 >2012-12-23 16:21:10,059 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] spmStart polling started: taskId = c2e0f14c-7ba0-4746-aa5a-d2518f7a85b0 >2012-12-23 16:21:11,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:13,674 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:16,050 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:18,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:20,112 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:20,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [78c94347] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:21:20,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-94) [78c94347] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:21:20,281 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] spmStart polling ended: taskId = c2e0f14c-7ba0-4746-aa5a-d2518f7a85b0 task status = finished >2012-12-23 16:21:20,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:21:20,304 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] spmStart polling ended, spm status: Free >2012-12-23 16:21:20,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) [78c94347] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c2e0f14c-7ba0-4746-aa5a-d2518f7a85b0), log id: 6663a7ea >2012-12-23 16:21:20,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-94) [78c94347] FINISH, HSMClearTaskVDSCommand, log id: 6663a7ea >2012-12-23 16:21:20,339 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-94) [78c94347] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@18a5282a, log id: 68b961a1 >2012-12-23 16:21:20,341 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-94) [2efea0a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:21:20,413 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-94) [2efea0a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:21:22,174 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:24,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:26,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:21:30,438 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [2cc795b9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:21:30,493 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [2cc795b9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:21:30,494 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5ca69be6 >2012-12-23 16:21:30,517 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] spmStart polling started: taskId = c7c44e9c-efe6-439b-824b-84540d8501b5 >2012-12-23 16:21:40,767 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [2cc795b9] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:21:40,767 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [2cc795b9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:21:40,767 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] spmStart polling ended: taskId = c7c44e9c-efe6-439b-824b-84540d8501b5 task status = finished >2012-12-23 16:21:40,767 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:21:40,785 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] spmStart polling ended, spm status: Free >2012-12-23 16:21:40,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c7c44e9c-efe6-439b-824b-84540d8501b5), log id: 3366cdc2 >2012-12-23 16:21:40,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] FINISH, HSMClearTaskVDSCommand, log id: 3366cdc2 >2012-12-23 16:21:40,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [2cc795b9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7aaae7f5, log id: 5ca69be6 >2012-12-23 16:21:40,812 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [6a62c4bd] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:21:40,849 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a62c4bd] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:21:50,874 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:21:50,902 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [2e43afda] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:21:50,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7fc40ba2 >2012-12-23 16:21:50,925 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] spmStart polling started: taskId = 8b9ef419-9cf3-44f0-8ee1-da7820cafa14 >2012-12-23 16:22:01,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [2e43afda] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:22:01,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-95) [2e43afda] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:01,150 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] spmStart polling ended: taskId = 8b9ef419-9cf3-44f0-8ee1-da7820cafa14 task status = finished >2012-12-23 16:22:01,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:01,169 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] spmStart polling ended, spm status: Free >2012-12-23 16:22:01,170 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=8b9ef419-9cf3-44f0-8ee1-da7820cafa14), log id: 4008ccee >2012-12-23 16:22:01,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] FINISH, HSMClearTaskVDSCommand, log id: 4008ccee >2012-12-23 16:22:01,188 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-95) [2e43afda] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1c63e1a, log id: 7fc40ba2 >2012-12-23 16:22:01,190 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-95) [7e171dde] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:22:01,232 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-95) [7e171dde] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:22:11,257 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [295f87f1] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:22:11,265 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [295f87f1] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:22:11,267 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 92b28c3 >2012-12-23 16:22:11,289 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] spmStart polling started: taskId = be847b15-819c-4ee2-b019-d29565af830f >2012-12-23 16:22:21,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [295f87f1] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:22:21,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [295f87f1] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:21,516 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] spmStart polling ended: taskId = be847b15-819c-4ee2-b019-d29565af830f task status = finished >2012-12-23 16:22:21,516 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:21,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] spmStart polling ended, spm status: Free >2012-12-23 16:22:21,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=be847b15-819c-4ee2-b019-d29565af830f), log id: 552d5204 >2012-12-23 16:22:21,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] FINISH, HSMClearTaskVDSCommand, log id: 552d5204 >2012-12-23 16:22:21,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [295f87f1] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1263b04c, log id: 92b28c3 >2012-12-23 16:22:21,557 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [4ecb5702] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:22:21,675 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:22:31,703 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:22:31,727 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [7700bcc8] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:22:31,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 702f77f0 >2012-12-23 16:22:31,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] spmStart polling started: taskId = 679b9a84-6cb0-4733-94cb-92f4fee2b496 >2012-12-23 16:22:41,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [7700bcc8] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:22:41,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-83) [7700bcc8] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:41,990 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] spmStart polling ended: taskId = 679b9a84-6cb0-4733-94cb-92f4fee2b496 task status = finished >2012-12-23 16:22:41,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:22:42,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] spmStart polling ended, spm status: Free >2012-12-23 16:22:42,010 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=679b9a84-6cb0-4733-94cb-92f4fee2b496), log id: 1d51540e >2012-12-23 16:22:42,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] FINISH, HSMClearTaskVDSCommand, log id: 1d51540e >2012-12-23 16:22:42,028 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-83) [7700bcc8] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4665722b, log id: 702f77f0 >2012-12-23 16:22:42,030 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-83) [2e2a8928] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:22:42,084 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-83) [2e2a8928] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:22:52,110 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [2f1111f3] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:22:52,124 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [2f1111f3] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:22:52,126 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 17718bf3 >2012-12-23 16:22:52,148 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] spmStart polling started: taskId = 91cf3026-a851-4af6-978a-f468a2724afb >2012-12-23 16:23:02,399 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [2f1111f3] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:23:02,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-23) [2f1111f3] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:02,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] spmStart polling ended: taskId = 91cf3026-a851-4af6-978a-f468a2724afb task status = finished >2012-12-23 16:23:02,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:02,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] spmStart polling ended, spm status: Free >2012-12-23 16:23:02,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=91cf3026-a851-4af6-978a-f468a2724afb), log id: 6eee09f4 >2012-12-23 16:23:02,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] FINISH, HSMClearTaskVDSCommand, log id: 6eee09f4 >2012-12-23 16:23:02,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-23) [2f1111f3] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4dcfab11, log id: 17718bf3 >2012-12-23 16:23:02,442 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-23) [7ce810ff] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:23:02,539 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-23) [7ce810ff] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:23:12,577 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:23:12,589 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [2c726901] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:23:12,590 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 49708bc2 >2012-12-23 16:23:12,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] spmStart polling started: taskId = 09454d79-ac6f-44b7-8167-e849d8ec5e71 >2012-12-23 16:23:22,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [2c726901] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:23:22,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [2c726901] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:22,859 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] spmStart polling ended: taskId = 09454d79-ac6f-44b7-8167-e849d8ec5e71 task status = finished >2012-12-23 16:23:22,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:22,877 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] spmStart polling ended, spm status: Free >2012-12-23 16:23:22,879 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [2c726901] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=09454d79-ac6f-44b7-8167-e849d8ec5e71), log id: 6e1bcb9b >2012-12-23 16:23:22,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [2c726901] FINISH, HSMClearTaskVDSCommand, log id: 6e1bcb9b >2012-12-23 16:23:22,897 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [2c726901] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@62d46596, log id: 49708bc2 >2012-12-23 16:23:22,899 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [66598d8a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:23:22,958 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [66598d8a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:23:32,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:23:33,001 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [594628df] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:23:33,002 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 71c6fe7f >2012-12-23 16:23:33,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] spmStart polling started: taskId = ac481d02-366e-458b-846e-7b29ab45f2c7 >2012-12-23 16:23:43,275 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [594628df] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:23:43,276 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-6) [594628df] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:43,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] spmStart polling ended: taskId = ac481d02-366e-458b-846e-7b29ab45f2c7 task status = finished >2012-12-23 16:23:43,276 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:23:43,294 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] spmStart polling ended, spm status: Free >2012-12-23 16:23:43,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) [594628df] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ac481d02-366e-458b-846e-7b29ab45f2c7), log id: 3da551b5 >2012-12-23 16:23:43,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-6) [594628df] FINISH, HSMClearTaskVDSCommand, log id: 3da551b5 >2012-12-23 16:23:43,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-6) [594628df] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@309761b1, log id: 71c6fe7f >2012-12-23 16:23:43,317 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-6) [228ec463] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:23:43,407 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-6) [228ec463] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:23:53,433 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [4039836] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:23:53,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [4039836] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:23:53,451 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 596a0d69 >2012-12-23 16:23:53,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] spmStart polling started: taskId = 282a95b0-b3b6-4adf-94bc-63ca30d331ab >2012-12-23 16:24:03,740 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [4039836] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:24:03,740 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-11) [4039836] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:03,740 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] spmStart polling ended: taskId = 282a95b0-b3b6-4adf-94bc-63ca30d331ab task status = finished >2012-12-23 16:24:03,741 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:03,759 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] spmStart polling ended, spm status: Free >2012-12-23 16:24:03,760 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [4039836] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=282a95b0-b3b6-4adf-94bc-63ca30d331ab), log id: 5a18a628 >2012-12-23 16:24:03,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-11) [4039836] FINISH, HSMClearTaskVDSCommand, log id: 5a18a628 >2012-12-23 16:24:03,779 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-11) [4039836] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@844ba4e, log id: 596a0d69 >2012-12-23 16:24:03,781 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-11) [58235b1f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:24:04,508 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-11) [58235b1f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:24:14,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:24:14,546 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [b94e959] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:24:14,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6e6ab86b >2012-12-23 16:24:14,570 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] spmStart polling started: taskId = afda0cf5-a904-4a88-aede-f6a00da4fff7 >2012-12-23 16:24:22,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [b94e959] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:24:22,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [b94e959] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:22,775 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] spmStart polling ended: taskId = afda0cf5-a904-4a88-aede-f6a00da4fff7 task status = finished >2012-12-23 16:24:22,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:22,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] spmStart polling ended, spm status: Free >2012-12-23 16:24:22,797 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [b94e959] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=afda0cf5-a904-4a88-aede-f6a00da4fff7), log id: 1574adcd >2012-12-23 16:24:22,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [b94e959] FINISH, HSMClearTaskVDSCommand, log id: 1574adcd >2012-12-23 16:24:22,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [b94e959] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1f3e78bc, log id: 6e6ab86b >2012-12-23 16:24:22,818 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [3e688eaa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:24:22,850 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [3e688eaa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:24:28,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [5e1333e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:24:30,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:32,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [2e2a8928] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:32,876 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:24:32,892 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:24:32,894 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 71c7c7 >2012-12-23 16:24:32,928 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) spmStart polling started: taskId = c10488c3-b43b-465e-a581-f6e3e4180957 >2012-12-23 16:24:34,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:36,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:38,627 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-38) [4f7c234d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:40,712 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:42,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:43,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:24:43,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-3) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:43,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) spmStart polling ended: taskId = c10488c3-b43b-465e-a581-f6e3e4180957 task status = finished >2012-12-23 16:24:43,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:24:43,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) spmStart polling ended, spm status: Free >2012-12-23 16:24:43,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-3) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c10488c3-b43b-465e-a581-f6e3e4180957), log id: 23432a02 >2012-12-23 16:24:43,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-3) FINISH, HSMClearTaskVDSCommand, log id: 23432a02 >2012-12-23 16:24:43,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-3) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@e7afb64, log id: 71c7c7 >2012-12-23 16:24:43,193 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-3) [2c0e69a9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:24:43,257 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-3) [2c0e69a9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:24:44,871 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:46,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:48,934 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-79) [148f905b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:51,264 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [5ead9898] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:53,284 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:24:53,310 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [58b091d2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:24:53,311 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2c2bf1d3 >2012-12-23 16:24:53,334 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:24:53,345 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] spmStart polling started: taskId = 6ae9e8f6-7695-4a61-8b3a-7d32f4e3cffe >2012-12-23 16:24:55,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:24:57,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [356f2527] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:24:59,617 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [561dda9] Checking autorecoverable hosts >2012-12-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [561dda9] Autorecovering 0 hosts >2012-12-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [561dda9] Checking autorecoverable hosts done >2012-12-23 16:25:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-52) [561dda9] Autorecovering storage domains is disabled, skipping >2012-12-23 16:25:01,653 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-75) [6a62c4bd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:25:03,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [58b091d2] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:25:03,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-20) [58b091d2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:03,582 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] spmStart polling ended: taskId = 6ae9e8f6-7695-4a61-8b3a-7d32f4e3cffe task status = finished >2012-12-23 16:25:03,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:03,601 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] spmStart polling ended, spm status: Free >2012-12-23 16:25:03,602 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6ae9e8f6-7695-4a61-8b3a-7d32f4e3cffe), log id: 6a34be10 >2012-12-23 16:25:03,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] FINISH, HSMClearTaskVDSCommand, log id: 6a34be10 >2012-12-23 16:25:03,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-20) [58b091d2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2caa42e9, log id: 2c2bf1d3 >2012-12-23 16:25:03,623 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-20) [5e0ee5e7] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:25:03,710 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [b1380a9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:04,154 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-20) [5e0ee5e7] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:25:06,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-39) [23e647cb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:08,400 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-92) [2046e8ae] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:10,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [228ec463] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:12,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:15,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [39e5d077] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:25:15,395 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [39e5d077] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:25:15,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 194c5968 >2012-12-23 16:25:15,421 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] spmStart polling started: taskId = 55ef2c87-bcd4-427d-af96-1db85b38ed49 >2012-12-23 16:25:21,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:23,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:25:23,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [39e5d077] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:25:23,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [39e5d077] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:23,623 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] spmStart polling ended: taskId = 55ef2c87-bcd4-427d-af96-1db85b38ed49 task status = finished >2012-12-23 16:25:23,623 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:23,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] spmStart polling ended, spm status: Free >2012-12-23 16:25:23,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=55ef2c87-bcd4-427d-af96-1db85b38ed49), log id: 62d8934d >2012-12-23 16:25:23,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] FINISH, HSMClearTaskVDSCommand, log id: 62d8934d >2012-12-23 16:25:23,662 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [39e5d077] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@78aed6ed, log id: 194c5968 >2012-12-23 16:25:23,664 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [1ea09f81] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:25:25,149 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [1ea09f81] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:25:26,967 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:29,021 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:31,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:33,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:35,175 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [459fb102] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:25:35,183 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [459fb102] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:25:35,184 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 724a4cda >2012-12-23 16:25:35,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] spmStart polling started: taskId = 991b4f4d-e4fc-4d89-b4dd-865e9fad5382 >2012-12-23 16:25:36,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset by peer >2012-12-23 16:25:38,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:41,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [3e688eaa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:43,376 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [459fb102] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:25:43,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-24) [459fb102] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:43,377 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] spmStart polling ended: taskId = 991b4f4d-e4fc-4d89-b4dd-865e9fad5382 task status = finished >2012-12-23 16:25:43,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:25:43,396 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] spmStart polling ended, spm status: Free >2012-12-23 16:25:43,397 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [459fb102] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=991b4f4d-e4fc-4d89-b4dd-865e9fad5382), log id: 5e9c5fed >2012-12-23 16:25:43,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-24) [459fb102] FINISH, HSMClearTaskVDSCommand, log id: 5e9c5fed >2012-12-23 16:25:43,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-24) [459fb102] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6c5df121, log id: 724a4cda >2012-12-23 16:25:43,419 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-24) [b81e51c] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:25:43,463 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-24) [b81e51c] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:25:43,985 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [47af0e0c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:46,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:49,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:51,714 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-70) [53804b18] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:53,489 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [77a505fa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:25:53,512 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [77a505fa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:25:53,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1c4b3a5c >2012-12-23 16:25:53,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] spmStart polling started: taskId = 241f9f92-f470-4d87-aa0a-a3308d7c60bd >2012-12-23 16:25:54,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:56,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:25:58,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:00,561 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:02,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:04,653 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:04,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [77a505fa] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:26:04,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [77a505fa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:26:04,924 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] spmStart polling ended: taskId = 241f9f92-f470-4d87-aa0a-a3308d7c60bd task status = finished >2012-12-23 16:26:04,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:26:04,954 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] spmStart polling ended, spm status: Free >2012-12-23 16:26:04,956 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=241f9f92-f470-4d87-aa0a-a3308d7c60bd), log id: 2bf54409 >2012-12-23 16:26:04,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] FINISH, HSMClearTaskVDSCommand, log id: 2bf54409 >2012-12-23 16:26:04,975 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [77a505fa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7345c16a, log id: 1c4b3a5c >2012-12-23 16:26:04,977 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-96) [689d5145] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:26:05,012 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [689d5145] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:26:06,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:08,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-32) [14237e09] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:11,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:13,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [4c0f1f42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:15,038 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:26:15,070 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:26:15,071 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [43a65476] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 7bdc9aa5 >2012-12-23 16:26:15,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [43a65476] spmStart polling started: taskId = 3fe3b7d4-a07b-4b6d-bec5-ef43df0edfec >2012-12-23 16:26:15,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [730f1e71] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:17,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:19,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:21,639 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [b1380a9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:24,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-10) [3791c5e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:26,747 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:28,802 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-6) [228ec463] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:31,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-40) [2a5bad0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:33,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:36,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [58545dc5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:38,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:41,955 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [1ea09f81] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:44,054 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) [7cec87c0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:46,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [29025e4b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:48,511 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-54) [2ccc9ae2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:50,543 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-45) [723c9171] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:52,586 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:54,677 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:56,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-36) [3e688eaa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:26:58,820 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [47af0e0c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:01,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [5e1333e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:03,239 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:05,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-83) [2e2a8928] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:07,570 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:12,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1d195445] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:15,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-88) [1fab69cd] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:17,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-89) XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:19,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:21,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-94) [2efea0a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:23,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-13) [10dcdd2a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:25,832 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:28,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-25) [3022a282] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:30,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-97) [236a4c61] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:32,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-16) [66598d8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:34,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-19) [356f2527] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:36,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:38,540 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:40,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-33) [b1380a9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:42,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:44,819 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-27) [324d70a1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:46,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:48,959 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-81) [1d0786aa] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:51,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [7e171dde] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:53,280 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-51) [58545dc5] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:56,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-60) [214a09eb] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:27:58,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:00,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:02,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:04,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:06,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:08,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-72) [2cfd3156] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:11,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:13,424 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-69) [14d21584] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:28:15,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-37) [47af0e0c] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:29:15,998 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-7) Checking if user admin@internal is an admin, result true >2012-12-23 16:29:15,998 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-7) Running command: LoginAdminUserCommand internal: false. >2012-12-23 16:29:23,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] XML RPC error in command HSMGetTaskStatusVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:29:23,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [43a65476] Command org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.irsbroker.OneUuidReturnForXmlRpc >mUuid 3fe3b7d4-a07b-4b6d-bec5-ef43df0edfec >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 0 >mMessage OK > > >2012-12-23 16:29:23,302 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-21) [43a65476] HostName = orchid-vds2 >2012-12-23 16:29:23,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43a65476] Failed in SpmStartVDS method, for vds: orchid-vds2; host: orchid-vds2.qa.lab.tlv.redhat.com >2012-12-23 16:29:23,303 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-21) [43a65476] Command SpmStartVDS execution failed. Exception: NullPointerException: >2012-12-23 16:29:23,303 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-21) [43a65476] FINISH, SpmStartVDSCommand, log id: 7bdc9aa5 >2012-12-23 16:29:23,305 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-21) [43c69eaf] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:29:23,344 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-21) [43c69eaf] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:29:33,369 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:29:33,398 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [9602081] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:29:33,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2d154afc >2012-12-23 16:29:33,422 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] spmStart polling started: taskId = ab7d4c24-679c-4c95-bfaf-742f7fa5c457 >2012-12-23 16:29:34,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [9602081] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:29:34,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [9602081] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:29:34,448 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] spmStart polling ended: taskId = ab7d4c24-679c-4c95-bfaf-742f7fa5c457 task status = finished >2012-12-23 16:29:34,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:29:34,469 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] spmStart polling ended, spm status: Free >2012-12-23 16:29:34,470 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [9602081] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ab7d4c24-679c-4c95-bfaf-742f7fa5c457), log id: 61ed23e9 >2012-12-23 16:29:34,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [9602081] FINISH, HSMClearTaskVDSCommand, log id: 61ed23e9 >2012-12-23 16:29:34,489 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [9602081] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@17d0c839, log id: 2d154afc >2012-12-23 16:29:34,491 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-8) [c092266] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:29:34,756 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [c092266] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:29:44,781 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:29:44,841 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [5c55c6c6] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:29:44,842 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 27b21444 >2012-12-23 16:29:44,865 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] spmStart polling started: taskId = 5eeeae88-e368-43c7-b218-e42bcf336836 >2012-12-23 16:29:49,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [5c55c6c6] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:29:49,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-31) [5c55c6c6] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:29:49,987 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] spmStart polling ended: taskId = 5eeeae88-e368-43c7-b218-e42bcf336836 task status = finished >2012-12-23 16:29:49,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:29:50,005 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] spmStart polling ended, spm status: Free >2012-12-23 16:29:50,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5eeeae88-e368-43c7-b218-e42bcf336836), log id: 58957d2e >2012-12-23 16:29:50,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] FINISH, HSMClearTaskVDSCommand, log id: 58957d2e >2012-12-23 16:29:50,025 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-31) [5c55c6c6] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3e4d8471, log id: 27b21444 >2012-12-23 16:29:50,027 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-31) [533236ab] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:29:50,093 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-31) [533236ab] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:30:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [6a9b590e] Checking autorecoverable hosts >2012-12-23 16:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [6a9b590e] Autorecovering 0 hosts >2012-12-23 16:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [6a9b590e] Checking autorecoverable hosts done >2012-12-23 16:30:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-57) [6a9b590e] Autorecovering storage domains is disabled, skipping >2012-12-23 16:30:00,118 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:30:00,132 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [7a38c648] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:30:00,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: fcd3cb >2012-12-23 16:30:00,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] spmStart polling started: taskId = 808a295b-a8a6-408d-a0c0-5219372080a4 >2012-12-23 16:30:11,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [7a38c648] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:30:11,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-58) [7a38c648] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:11,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] spmStart polling ended: taskId = 808a295b-a8a6-408d-a0c0-5219372080a4 task status = finished >2012-12-23 16:30:11,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:11,596 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] spmStart polling ended, spm status: Free >2012-12-23 16:30:11,597 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=808a295b-a8a6-408d-a0c0-5219372080a4), log id: 6eb395dd >2012-12-23 16:30:11,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] FINISH, HSMClearTaskVDSCommand, log id: 6eb395dd >2012-12-23 16:30:11,617 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-58) [7a38c648] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@503418f2, log id: fcd3cb >2012-12-23 16:30:11,619 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-58) [c51e101] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:30:12,986 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-58) [c51e101] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:30:23,022 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:30:23,056 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [28f88b51] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:30:23,058 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5e10404b >2012-12-23 16:30:23,083 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] spmStart polling started: taskId = d39e8166-7de6-4c42-bdc3-fe752b47d93a >2012-12-23 16:30:31,260 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [28f88b51] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:30:31,260 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [28f88b51] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:31,260 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] spmStart polling ended: taskId = d39e8166-7de6-4c42-bdc3-fe752b47d93a task status = finished >2012-12-23 16:30:31,260 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:31,278 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] spmStart polling ended, spm status: Free >2012-12-23 16:30:31,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d39e8166-7de6-4c42-bdc3-fe752b47d93a), log id: 6d77704f >2012-12-23 16:30:31,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] FINISH, HSMClearTaskVDSCommand, log id: 6d77704f >2012-12-23 16:30:31,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [28f88b51] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@3c6e8aae, log id: 5e10404b >2012-12-23 16:30:31,300 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-4) [7d52c480] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:30:31,355 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [7d52c480] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:30:41,386 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [689d5145] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:30:41,448 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [689d5145] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:30:41,450 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2462250f >2012-12-23 16:30:41,472 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] spmStart polling started: taskId = 0f74c49e-11fd-49b3-b95c-2196770081a3 >2012-12-23 16:30:51,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [689d5145] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:30:51,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-96) [689d5145] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:51,708 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] spmStart polling ended: taskId = 0f74c49e-11fd-49b3-b95c-2196770081a3 task status = finished >2012-12-23 16:30:51,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:30:51,727 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] spmStart polling ended, spm status: Free >2012-12-23 16:30:51,728 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) [689d5145] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=0f74c49e-11fd-49b3-b95c-2196770081a3), log id: 742254f1 >2012-12-23 16:30:51,761 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-96) [689d5145] FINISH, HSMClearTaskVDSCommand, log id: 742254f1 >2012-12-23 16:30:51,761 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-96) [689d5145] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@79f6d5c7, log id: 2462250f >2012-12-23 16:30:51,763 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-96) [3c4d3a5f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:30:51,814 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-96) [3c4d3a5f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:31:01,849 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a62c4bd] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:31:01,876 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [6a62c4bd] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:31:01,878 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6dccb02f >2012-12-23 16:31:01,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] spmStart polling started: taskId = c5f87c86-d49f-4caf-b3af-45a6664e17d1 >2012-12-23 16:31:12,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [6a62c4bd] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:31:12,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-75) [6a62c4bd] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:12,138 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] spmStart polling ended: taskId = c5f87c86-d49f-4caf-b3af-45a6664e17d1 task status = finished >2012-12-23 16:31:12,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:12,156 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] spmStart polling ended, spm status: Free >2012-12-23 16:31:12,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=c5f87c86-d49f-4caf-b3af-45a6664e17d1), log id: 2d903e73 >2012-12-23 16:31:12,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] FINISH, HSMClearTaskVDSCommand, log id: 2d903e73 >2012-12-23 16:31:12,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-75) [6a62c4bd] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@58f40763, log id: 6dccb02f >2012-12-23 16:31:12,180 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-75) [7d112234] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:31:12,224 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-75) [7d112234] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:31:17,550 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-91) [5e1333e4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:31:19,695 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:21,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-12) [9c6c7f1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:22,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [c092266] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:31:22,381 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [c092266] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:31:22,383 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 21a03b87 >2012-12-23 16:31:22,405 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] spmStart polling started: taskId = 7018e888-9f0d-446f-9d8f-222af1d6ea39 >2012-12-23 16:31:24,095 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-63) [1e16368b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:26,683 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:28,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-17) [1ea09f81] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:31,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:32,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [c092266] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:31:32,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-8) [c092266] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:32,656 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] spmStart polling ended: taskId = 7018e888-9f0d-446f-9d8f-222af1d6ea39 task status = finished >2012-12-23 16:31:32,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:32,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] spmStart polling ended, spm status: Free >2012-12-23 16:31:32,675 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [c092266] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=7018e888-9f0d-446f-9d8f-222af1d6ea39), log id: 209b8fc3 >2012-12-23 16:31:32,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-8) [c092266] FINISH, HSMClearTaskVDSCommand, log id: 209b8fc3 >2012-12-23 16:31:32,693 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-8) [c092266] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@44fb5bee, log id: 21a03b87 >2012-12-23 16:31:32,695 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-8) [525089a3] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:31:32,968 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-8) [525089a3] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:31:33,678 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-48) [464e572a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:36,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-46) [29025e4b] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:38,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:40,651 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-47) [47c532ba] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:41,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-57) [6a9b590e] XML RPC error in command ListVDS ( HostName = orchid-vds2 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:41,924 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (QuartzScheduler_Worker-57) [6a9b590e] ResourceManager::refreshVdsRunTimeInfo::Failed to refresh VDS , vds = 2d10c76a-49a9-11e2-9ecf-001122334455 : orchid-vds2, VDS Network Error, continuing. >VDSNetworkException: >2012-12-23 16:31:45,439 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-69) [36fa983e] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 16:31:45,611 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-69) [18393e44] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:31:45,612 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-69) [18393e44] START, ConnectStorageServerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 7a2e7666 >2012-12-23 16:31:45,638 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-69) [18393e44] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 7a2e7666 >2012-12-23 16:31:45,638 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-69) [18393e44] Host orchid-vds2 storage connection was succeeded >2012-12-23 16:31:45,709 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-69) [18393e44] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 2, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 1d717940 >2012-12-23 16:31:45,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-69) [18393e44] FINISH, ConnectStoragePoolVDSCommand, log id: 1d717940 >2012-12-23 16:31:45,770 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-69) [18393e44] No string for UNASSIGNED type. Use default Log >2012-12-23 16:31:45,772 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-10) [18393e44] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 16:31:45,790 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-69) [6984147f] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 16:31:45,805 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 2d10c76a-49a9-11e2-9ecf-001122334455 Type: VDS >2012-12-23 16:31:52,999 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [4aa6a560] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:31:53,103 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [4aa6a560] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:31:53,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 548b8eec >2012-12-23 16:31:53,132 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] spmStart polling started: taskId = 5c9a2b75-f02f-49ad-99d0-f9752b6f76de >2012-12-23 16:31:54,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [4aa6a560] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:31:54,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-41) [4aa6a560] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:54,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] spmStart polling ended: taskId = 5c9a2b75-f02f-49ad-99d0-f9752b6f76de task status = finished >2012-12-23 16:31:54,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:31:54,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] spmStart polling ended, spm status: Free >2012-12-23 16:31:54,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5c9a2b75-f02f-49ad-99d0-f9752b6f76de), log id: 2c87d8c2 >2012-12-23 16:31:54,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] FINISH, HSMClearTaskVDSCommand, log id: 2c87d8c2 >2012-12-23 16:31:54,192 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-41) [4aa6a560] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@aa7bf65, log id: 548b8eec >2012-12-23 16:31:54,194 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-41) [b06855a] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:31:54,387 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-41) [b06855a] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:31:57,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-68) [128b3ba1] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:31:59,815 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-86) [279f0879] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:01,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-50) [38663b8e] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:03,950 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-7) [1d195445] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:04,412 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:32:04,938 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [743958a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:32:04,940 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 45870b63 >2012-12-23 16:32:04,962 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] spmStart polling started: taskId = b3fae017-61fc-4b34-a239-ef43bff61ccf >2012-12-23 16:32:06,949 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-78) [3761dec2] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:08,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-77) [350dcae7] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:11,136 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-5) [485768d4] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:13,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [743958a] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:32:13,143 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-14) [743958a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:13,143 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] spmStart polling ended: taskId = b3fae017-61fc-4b34-a239-ef43bff61ccf task status = finished >2012-12-23 16:32:13,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:13,162 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] spmStart polling ended, spm status: Free >2012-12-23 16:32:13,163 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [743958a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b3fae017-61fc-4b34-a239-ef43bff61ccf), log id: 55c2b499 >2012-12-23 16:32:13,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-14) [743958a] FINISH, HSMClearTaskVDSCommand, log id: 55c2b499 >2012-12-23 16:32:13,182 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-14) [743958a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@61ded4cb, log id: 45870b63 >2012-12-23 16:32:13,184 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-14) [6c648d9f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:32:13,206 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:13,211 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-14) [6c648d9f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:32:15,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-26) [553aac8a] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:17,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-61) [5ead9898] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:19,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:21,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-76) [4c0f1f42] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:23,236 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [66598d8a] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:32:23,249 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [66598d8a] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:32:23,250 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 327c14d3 >2012-12-23 16:32:23,272 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] spmStart polling started: taskId = 5a7bc0e7-f553-417b-ba57-3c21128e00f6 >2012-12-23 16:32:23,936 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-34) [5b426f64] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:26,172 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:28,205 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:30,241 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-18) [365bec2d] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:32,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-100) [16f3d674] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:33,475 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-8) [73ecfa05] Running command: LogoutUserCommand internal: false. >2012-12-23 16:32:33,605 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (QuartzScheduler_Worker-75) [7d112234] DbUserCacheManager::refreshAllUserData() - entered >2012-12-23 16:32:34,336 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43c69eaf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:34,530 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [66598d8a] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:32:34,530 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [66598d8a] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:34,530 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] spmStart polling ended: taskId = 5a7bc0e7-f553-417b-ba57-3c21128e00f6 task status = finished >2012-12-23 16:32:34,530 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:34,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] spmStart polling ended, spm status: Free >2012-12-23 16:32:34,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5a7bc0e7-f553-417b-ba57-3c21128e00f6), log id: 1520317 >2012-12-23 16:32:34,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] FINISH, HSMClearTaskVDSCommand, log id: 1520317 >2012-12-23 16:32:34,568 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [66598d8a] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2f48dbae, log id: 327c14d3 >2012-12-23 16:32:34,570 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [584e94c2] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:32:34,719 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [584e94c2] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:32:36,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-30) [1ec2ea25] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:38,802 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-49) [32f29eff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:41,318 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-95) [7e171dde] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:43,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-1) [7cb8f567] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:44,743 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:32:44,755 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7d721213] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:32:44,758 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5d877d22 >2012-12-23 16:32:44,793 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] spmStart polling started: taskId = 850f09ef-f410-469b-a8ba-e42ac73fc0fa >2012-12-23 16:32:45,379 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-67) [4a6ef728] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:47,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-66) [13fd8b35] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:32:55,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [7d721213] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:32:55,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-28) [7d721213] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:55,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] spmStart polling ended: taskId = 850f09ef-f410-469b-a8ba-e42ac73fc0fa task status = finished >2012-12-23 16:32:55,302 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:32:55,320 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] spmStart polling ended, spm status: Free >2012-12-23 16:32:55,321 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) [7d721213] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=850f09ef-f410-469b-a8ba-e42ac73fc0fa), log id: 7c3d2afb >2012-12-23 16:32:55,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-28) [7d721213] FINISH, HSMClearTaskVDSCommand, log id: 7c3d2afb >2012-12-23 16:32:55,340 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-28) [7d721213] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@13d10476, log id: 5d877d22 >2012-12-23 16:32:55,342 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-28) [7f7be923] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:32:55,379 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-28) [7f7be923] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:33:05,405 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [3e688eaa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:33:05,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [3e688eaa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:33:05,474 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6d9971d2 >2012-12-23 16:33:05,497 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] spmStart polling started: taskId = 2d615834-8582-4b62-ba44-b5427d59fa99 >2012-12-23 16:33:14,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [3e688eaa] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:33:14,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [3e688eaa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:14,691 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] spmStart polling ended: taskId = 2d615834-8582-4b62-ba44-b5427d59fa99 task status = finished >2012-12-23 16:33:14,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:14,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] spmStart polling ended, spm status: Free >2012-12-23 16:33:14,711 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=2d615834-8582-4b62-ba44-b5427d59fa99), log id: 79622eb4 >2012-12-23 16:33:14,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] FINISH, HSMClearTaskVDSCommand, log id: 79622eb4 >2012-12-23 16:33:14,731 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [3e688eaa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@75c52acf, log id: 6d9971d2 >2012-12-23 16:33:14,733 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [637db870] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:33:14,759 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [637db870] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:33:24,785 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:33:24,809 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:33:24,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 252392c0 >2012-12-23 16:33:24,844 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) spmStart polling started: taskId = ebd0f945-272a-45d5-bbc3-dcc4ee151a84 >2012-12-23 16:33:36,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-80) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:33:36,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-80) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:36,116 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) spmStart polling ended: taskId = ebd0f945-272a-45d5-bbc3-dcc4ee151a84 task status = finished >2012-12-23 16:33:36,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:36,135 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) spmStart polling ended, spm status: Free >2012-12-23 16:33:36,136 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-80) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=ebd0f945-272a-45d5-bbc3-dcc4ee151a84), log id: 76d45966 >2012-12-23 16:33:36,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-80) FINISH, HSMClearTaskVDSCommand, log id: 76d45966 >2012-12-23 16:33:36,154 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-80) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@6f39747c, log id: 252392c0 >2012-12-23 16:33:36,156 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-80) [250eb1f0] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:33:36,266 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-80) [250eb1f0] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:33:46,302 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:33:46,315 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [337c7b8f] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:33:46,316 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74b908e4 >2012-12-23 16:33:46,338 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] spmStart polling started: taskId = 98b1f280-cd42-4658-b2ad-611146bda7c9 >2012-12-23 16:33:56,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [337c7b8f] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:33:56,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-29) [337c7b8f] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:56,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] spmStart polling ended: taskId = 98b1f280-cd42-4658-b2ad-611146bda7c9 task status = finished >2012-12-23 16:33:56,603 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:33:56,621 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] spmStart polling ended, spm status: Free >2012-12-23 16:33:56,622 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=98b1f280-cd42-4658-b2ad-611146bda7c9), log id: 24892dbc >2012-12-23 16:33:56,640 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] FINISH, HSMClearTaskVDSCommand, log id: 24892dbc >2012-12-23 16:33:56,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-29) [337c7b8f] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2a19a461, log id: 74b908e4 >2012-12-23 16:33:56,642 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-29) [7976f1de] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:33:56,703 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-29) [7976f1de] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:34:06,729 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:34:06,786 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [25ebea01] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:34:06,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 25462c9 >2012-12-23 16:34:06,813 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] spmStart polling started: taskId = adbd0926-063e-4343-98c9-076fb67e340f >2012-12-23 16:34:16,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [25ebea01] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:34:16,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-84) [25ebea01] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:16,988 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] spmStart polling ended: taskId = adbd0926-063e-4343-98c9-076fb67e340f task status = finished >2012-12-23 16:34:16,988 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:17,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] spmStart polling ended, spm status: Free >2012-12-23 16:34:17,007 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=adbd0926-063e-4343-98c9-076fb67e340f), log id: 4320060c >2012-12-23 16:34:17,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] FINISH, HSMClearTaskVDSCommand, log id: 4320060c >2012-12-23 16:34:17,027 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-84) [25ebea01] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@39258aee, log id: 25462c9 >2012-12-23 16:34:17,029 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-84) [4fc42c91] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:34:17,065 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-84) [4fc42c91] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:34:27,090 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [62170e01] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:34:27,280 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [62170e01] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:34:27,283 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 2e6aafa0 >2012-12-23 16:34:27,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] spmStart polling started: taskId = 64677b9c-2338-4f81-bc2c-84c1672daae4 >2012-12-23 16:34:37,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [62170e01] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:34:37,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-62) [62170e01] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:37,542 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] spmStart polling ended: taskId = 64677b9c-2338-4f81-bc2c-84c1672daae4 task status = finished >2012-12-23 16:34:37,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:37,561 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] spmStart polling ended, spm status: Free >2012-12-23 16:34:37,562 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [62170e01] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=64677b9c-2338-4f81-bc2c-84c1672daae4), log id: 2f79ab6b >2012-12-23 16:34:37,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-62) [62170e01] FINISH, HSMClearTaskVDSCommand, log id: 2f79ab6b >2012-12-23 16:34:37,580 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-62) [62170e01] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5ce51626, log id: 2e6aafa0 >2012-12-23 16:34:37,582 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-62) [4411486f] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:34:37,663 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-62) [4411486f] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:34:47,689 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:34:47,717 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:34:47,718 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6593748d >2012-12-23 16:34:47,741 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] spmStart polling started: taskId = 1bfd1b2b-26cd-46e2-9ed9-700f647dbad8 >2012-12-23 16:34:57,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [2e0ceeb3] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:34:57,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-73) [2e0ceeb3] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:57,981 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] spmStart polling ended: taskId = 1bfd1b2b-26cd-46e2-9ed9-700f647dbad8 task status = finished >2012-12-23 16:34:57,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:34:57,999 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] spmStart polling ended, spm status: Free >2012-12-23 16:34:58,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=1bfd1b2b-26cd-46e2-9ed9-700f647dbad8), log id: 57171afb >2012-12-23 16:34:58,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] FINISH, HSMClearTaskVDSCommand, log id: 57171afb >2012-12-23 16:34:58,018 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-73) [2e0ceeb3] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2dec8168, log id: 6593748d >2012-12-23 16:34:58,020 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-73) [223ea66] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:34:58,046 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-73) [223ea66] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:35:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [b81e51c] Checking autorecoverable hosts >2012-12-23 16:35:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [b81e51c] Autorecovering 0 hosts >2012-12-23 16:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [b81e51c] Checking autorecoverable hosts done >2012-12-23 16:35:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-24) [b81e51c] Autorecovering storage domains is disabled, skipping >2012-12-23 16:35:08,088 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:35:08,156 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [ca22fcf] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:35:08,158 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6281fa97 >2012-12-23 16:35:08,180 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] spmStart polling started: taskId = a35d06d3-15e6-4f8d-b692-716a9a0af2a1 >2012-12-23 16:35:18,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [ca22fcf] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:35:18,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-65) [ca22fcf] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:18,443 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] spmStart polling ended: taskId = a35d06d3-15e6-4f8d-b692-716a9a0af2a1 task status = finished >2012-12-23 16:35:18,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:18,462 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] spmStart polling ended, spm status: Free >2012-12-23 16:35:18,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a35d06d3-15e6-4f8d-b692-716a9a0af2a1), log id: 45b4a4eb >2012-12-23 16:35:18,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] FINISH, HSMClearTaskVDSCommand, log id: 45b4a4eb >2012-12-23 16:35:18,482 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-65) [ca22fcf] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@56b7640d, log id: 6281fa97 >2012-12-23 16:35:18,484 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-65) [2209bdf5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:35:18,532 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-65) [2209bdf5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:35:28,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:35:29,021 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:35:29,023 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 5d213a0b >2012-12-23 16:35:29,047 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) spmStart polling started: taskId = 774cc3bc-017a-40f7-a764-554e8aa26830 >2012-12-23 16:35:39,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) Failed in HSMGetTaskStatusVDS method >2012-12-23 16:35:39,268 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:39,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) spmStart polling ended: taskId = 774cc3bc-017a-40f7-a764-554e8aa26830 task status = finished >2012-12-23 16:35:39,268 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:39,285 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) spmStart polling ended, spm status: Free >2012-12-23 16:35:39,287 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-89) START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=774cc3bc-017a-40f7-a764-554e8aa26830), log id: 628626fe >2012-12-23 16:35:39,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-89) FINISH, HSMClearTaskVDSCommand, log id: 628626fe >2012-12-23 16:35:39,305 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@556a203a, log id: 5d213a0b >2012-12-23 16:35:39,310 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-89) [2a69eba5] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:35:39,418 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) [2a69eba5] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:35:49,474 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [356f2527] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:35:49,520 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [356f2527] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:35:49,521 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4a0eef33 >2012-12-23 16:35:49,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-99) [5cbcd232] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:35:49,547 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] spmStart polling started: taskId = 4de1d7a2-959d-49ec-867a-829a060cd53d >2012-12-23 16:35:59,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) [356f2527] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:35:59,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-19) [356f2527] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:59,830 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] spmStart polling ended: taskId = 4de1d7a2-959d-49ec-867a-829a060cd53d task status = finished >2012-12-23 16:35:59,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:35:59,848 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] spmStart polling ended, spm status: Free >2012-12-23 16:35:59,849 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) [356f2527] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=4de1d7a2-959d-49ec-867a-829a060cd53d), log id: 7a57cdd9 >2012-12-23 16:35:59,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-19) [356f2527] FINISH, HSMClearTaskVDSCommand, log id: 7a57cdd9 >2012-12-23 16:35:59,868 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-19) [356f2527] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1a8ba04f, log id: 4a0eef33 >2012-12-23 16:35:59,871 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-19) [44c9b026] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:36:00,109 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-19) [44c9b026] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:36:10,136 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [584e94c2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:36:10,450 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [584e94c2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:36:10,452 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 11c8303 >2012-12-23 16:36:10,475 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] spmStart polling started: taskId = 9d3163a7-e5cd-4e20-9bdc-ef4793e5b910 >2012-12-23 16:36:20,769 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [584e94c2] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:36:20,769 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-16) [584e94c2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:36:20,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] spmStart polling ended: taskId = 9d3163a7-e5cd-4e20-9bdc-ef4793e5b910 task status = finished >2012-12-23 16:36:20,769 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:36:20,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] spmStart polling ended, spm status: Free >2012-12-23 16:36:20,788 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9d3163a7-e5cd-4e20-9bdc-ef4793e5b910), log id: 386d7b34 >2012-12-23 16:36:20,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] FINISH, HSMClearTaskVDSCommand, log id: 386d7b34 >2012-12-23 16:36:20,816 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-16) [584e94c2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@343b917, log id: 11c8303 >2012-12-23 16:36:20,817 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-16) [532c96ad] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:36:20,843 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-16) [532c96ad] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:36:30,874 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [7cec87c0] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:36:30,886 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [7cec87c0] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:36:30,888 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 46915f19 >2012-12-23 16:36:30,910 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] spmStart polling started: taskId = 3d98322f-bf19-4235-9a8f-8b36f123969c >2012-12-23 16:36:41,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [7cec87c0] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:36:41,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-43) [7cec87c0] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:36:41,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] spmStart polling ended: taskId = 3d98322f-bf19-4235-9a8f-8b36f123969c task status = finished >2012-12-23 16:36:41,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:36:41,172 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] spmStart polling ended, spm status: Free >2012-12-23 16:36:41,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3d98322f-bf19-4235-9a8f-8b36f123969c), log id: 3dc8ea20 >2012-12-23 16:36:41,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] FINISH, HSMClearTaskVDSCommand, log id: 3dc8ea20 >2012-12-23 16:36:41,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-43) [7cec87c0] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@5182fa90, log id: 46915f19 >2012-12-23 16:36:41,194 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-43) [6e102dbe] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:36:41,257 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-43) [6e102dbe] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:36:52,281 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:36:52,292 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:36:52,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 205841a7 >2012-12-23 16:36:52,315 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] spmStart polling started: taskId = 12774767-4ed9-4390-b840-64b203507b00 >2012-12-23 16:37:01,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [6cf7b9ce] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:37:01,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-69) [6cf7b9ce] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:37:01,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] spmStart polling ended: taskId = 12774767-4ed9-4390-b840-64b203507b00 task status = finished >2012-12-23 16:37:01,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:37:01,471 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] spmStart polling ended, spm status: Free >2012-12-23 16:37:01,473 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=12774767-4ed9-4390-b840-64b203507b00), log id: e2e3675 >2012-12-23 16:37:01,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] FINISH, HSMClearTaskVDSCommand, log id: e2e3675 >2012-12-23 16:37:01,491 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-69) [6cf7b9ce] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@7bf94298, log id: 205841a7 >2012-12-23 16:37:01,493 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-69) [298348be] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:37:01,903 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-69) [298348be] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:37:11,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:37:11,944 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [4d4ff261] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:37:11,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 74242322 >2012-12-23 16:37:11,967 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] spmStart polling started: taskId = 6cc72de1-1833-4371-92e0-0c40d7cef431 >2012-12-23 16:37:17,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-22) [177436ee] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:37:19,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-74) [463a2aad] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:37:21,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-4) [7d52c480] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:37:22,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [4d4ff261] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:37:22,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-53) [4d4ff261] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:37:22,204 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] spmStart polling ended: taskId = 6cc72de1-1833-4371-92e0-0c40d7cef431 task status = finished >2012-12-23 16:37:22,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:37:22,223 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] spmStart polling ended, spm status: Free >2012-12-23 16:37:22,224 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=6cc72de1-1833-4371-92e0-0c40d7cef431), log id: 4d2cec8 >2012-12-23 16:37:22,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] FINISH, HSMClearTaskVDSCommand, log id: 4d2cec8 >2012-12-23 16:37:22,246 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-53) [4d4ff261] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c05aef1, log id: 74242322 >2012-12-23 16:37:22,249 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-53) [292066cb] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:37:22,303 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-53) [292066cb] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:37:23,856 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-80) [250eb1f0] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:37:32,331 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) [2a69eba5] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:37:32,347 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) [2a69eba5] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:37:32,349 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 27304221 >2012-12-23 16:37:32,372 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] spmStart polling started: taskId = f3752c87-d3d8-421f-b093-73c31c690be6 >2012-12-23 16:38:47,517 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:38:47,520 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=uDj7e4yGmwZK, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 79b2ab2d >2012-12-23 16:38:49,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) [2a69eba5] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:38:49,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-89) [2a69eba5] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:38:49,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] spmStart polling ended: taskId = f3752c87-d3d8-421f-b093-73c31c690be6 task status = finished >2012-12-23 16:38:49,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:38:49,534 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] spmStart polling ended, spm status: Free >2012-12-23 16:38:49,536 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=f3752c87-d3d8-421f-b093-73c31c690be6), log id: 172939cf >2012-12-23 16:38:49,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] FINISH, HSMClearTaskVDSCommand, log id: 172939cf >2012-12-23 16:38:49,556 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-89) [2a69eba5] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@139250ea, log id: 27304221 >2012-12-23 16:38:49,558 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-89) [6afe3caf] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:38:49,600 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-89) [6afe3caf] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:38:59,625 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [1ea09f81] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:38:59,706 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [1ea09f81] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:38:59,707 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 4cbab836 >2012-12-23 16:38:59,730 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] spmStart polling started: taskId = b89bdce3-0eec-4e59-a591-5f0a4c044723 >2012-12-23 16:39:04,851 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [1ea09f81] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:39:04,852 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-17) [1ea09f81] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:04,852 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] spmStart polling ended: taskId = b89bdce3-0eec-4e59-a591-5f0a4c044723 task status = finished >2012-12-23 16:39:04,852 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:04,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] spmStart polling ended, spm status: Free >2012-12-23 16:39:04,872 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=b89bdce3-0eec-4e59-a591-5f0a4c044723), log id: 4378eca8 >2012-12-23 16:39:04,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] FINISH, HSMClearTaskVDSCommand, log id: 4378eca8 >2012-12-23 16:39:04,891 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-17) [1ea09f81] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@37f92c33, log id: 4cbab836 >2012-12-23 16:39:04,893 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-17) [47c4e4fa] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:39:04,927 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-17) [47c4e4fa] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:39:14,953 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:39:14,973 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [4ecb5702] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:39:14,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 6691df07 >2012-12-23 16:39:14,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] spmStart polling started: taskId = 3ab66631-960d-4419-a931-5110f51d3766 >2012-12-23 16:39:25,220 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [4ecb5702] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:39:25,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-90) [4ecb5702] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:25,221 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] spmStart polling ended: taskId = 3ab66631-960d-4419-a931-5110f51d3766 task status = finished >2012-12-23 16:39:25,221 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:25,239 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] spmStart polling ended, spm status: Free >2012-12-23 16:39:25,240 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=3ab66631-960d-4419-a931-5110f51d3766), log id: 3c1423a4 >2012-12-23 16:39:25,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] FINISH, HSMClearTaskVDSCommand, log id: 3c1423a4 >2012-12-23 16:39:25,259 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-90) [4ecb5702] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@4e3002cc, log id: 6691df07 >2012-12-23 16:39:25,261 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-90) [3207c72e] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:39:25,287 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-90) [3207c72e] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:39:35,321 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:39:35,334 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [28a2f6dc] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:39:35,335 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 794f7495 >2012-12-23 16:39:35,358 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] spmStart polling started: taskId = 5f534153-c95b-440e-a6d2-65732e96f526 >2012-12-23 16:39:45,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [28a2f6dc] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:39:45,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-93) [28a2f6dc] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:45,598 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] spmStart polling ended: taskId = 5f534153-c95b-440e-a6d2-65732e96f526 task status = finished >2012-12-23 16:39:45,598 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:39:45,616 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] spmStart polling ended, spm status: Free >2012-12-23 16:39:45,618 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=5f534153-c95b-440e-a6d2-65732e96f526), log id: 2d8f665e >2012-12-23 16:39:45,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] FINISH, HSMClearTaskVDSCommand, log id: 2d8f665e >2012-12-23 16:39:45,637 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-93) [28a2f6dc] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2189bcb0, log id: 794f7495 >2012-12-23 16:39:45,639 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-93) [59c2d803] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:39:45,668 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-93) [59c2d803] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:39:55,694 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:39:55,708 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [78af2935] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:39:55,710 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 705174ac >2012-12-23 16:39:55,732 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] spmStart polling started: taskId = 9fd76177-5a4c-4678-9e2d-b2ee5db02c03 >2012-12-23 16:40:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Checking autorecoverable hosts >2012-12-23 16:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Autorecovering 0 hosts >2012-12-23 16:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Checking autorecoverable hosts done >2012-12-23 16:40:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-13) [10dcdd2a] Autorecovering storage domains is disabled, skipping >2012-12-23 16:40:05,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [78af2935] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:40:05,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-2) [78af2935] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:05,980 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] spmStart polling ended: taskId = 9fd76177-5a4c-4678-9e2d-b2ee5db02c03 task status = finished >2012-12-23 16:40:05,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:05,998 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] spmStart polling ended, spm status: Free >2012-12-23 16:40:06,000 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [78af2935] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=9fd76177-5a4c-4678-9e2d-b2ee5db02c03), log id: 3c72eaff >2012-12-23 16:40:06,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-2) [78af2935] FINISH, HSMClearTaskVDSCommand, log id: 3c72eaff >2012-12-23 16:40:06,019 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-2) [78af2935] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@1ca22a5a, log id: 705174ac >2012-12-23 16:40:06,021 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-2) [5a8a8965] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:40:06,111 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-2) [5a8a8965] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:40:16,137 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:40:16,151 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [386fbe3e] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:40:16,152 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 137586ea >2012-12-23 16:40:16,175 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] spmStart polling started: taskId = e6818202-70c4-4619-bd03-e211b0db7fbc >2012-12-23 16:40:26,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-23) [7ce810ff] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:40:26,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [386fbe3e] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:40:26,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-85) [386fbe3e] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:26,398 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] spmStart polling ended: taskId = e6818202-70c4-4619-bd03-e211b0db7fbc task status = finished >2012-12-23 16:40:26,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:26,417 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] spmStart polling ended, spm status: Free >2012-12-23 16:40:26,418 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=e6818202-70c4-4619-bd03-e211b0db7fbc), log id: 6fb9d81d >2012-12-23 16:40:26,436 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] FINISH, HSMClearTaskVDSCommand, log id: 6fb9d81d >2012-12-23 16:40:26,437 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-85) [386fbe3e] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@121b9139, log id: 137586ea >2012-12-23 16:40:26,438 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-85) [4fdb3e78] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:40:26,465 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-85) [4fdb3e78] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:40:36,492 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [1d0786aa] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:40:36,529 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [1d0786aa] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:40:36,531 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 1d80a71f >2012-12-23 16:40:36,553 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] spmStart polling started: taskId = a8abf927-f4ba-4f98-abfc-11c0ac042c8e >2012-12-23 16:40:46,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [1d0786aa] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:40:46,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-81) [1d0786aa] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:46,790 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] spmStart polling ended: taskId = a8abf927-f4ba-4f98-abfc-11c0ac042c8e task status = finished >2012-12-23 16:40:46,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:40:46,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] spmStart polling ended, spm status: Free >2012-12-23 16:40:46,810 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=a8abf927-f4ba-4f98-abfc-11c0ac042c8e), log id: 44e7bc11 >2012-12-23 16:40:46,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] FINISH, HSMClearTaskVDSCommand, log id: 44e7bc11 >2012-12-23 16:40:46,828 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-81) [1d0786aa] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@49ec236e, log id: 1d80a71f >2012-12-23 16:40:46,830 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-81) [2e0a30ac] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:40:46,856 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-81) [2e0a30ac] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:40:56,882 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:40:56,894 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [3530ef2] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:40:56,896 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3bd5dfea >2012-12-23 16:40:56,919 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] spmStart polling started: taskId = d2c15556-9ed5-461e-bf17-09c3283e7958 >2012-12-23 16:41:08,176 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [3530ef2] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:41:08,176 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-42) [3530ef2] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:08,176 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] spmStart polling ended: taskId = d2c15556-9ed5-461e-bf17-09c3283e7958 task status = finished >2012-12-23 16:41:08,176 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:08,196 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] spmStart polling ended, spm status: Free >2012-12-23 16:41:08,197 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=d2c15556-9ed5-461e-bf17-09c3283e7958), log id: 54dbd563 >2012-12-23 16:41:08,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] FINISH, HSMClearTaskVDSCommand, log id: 54dbd563 >2012-12-23 16:41:08,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-42) [3530ef2] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@2c96821b, log id: 3bd5dfea >2012-12-23 16:41:08,221 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-42) [4d37d17b] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:41:08,428 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-42) [4d37d17b] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:41:18,473 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [637db870] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:41:18,485 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [637db870] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:41:18,486 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: bd1c70f >2012-12-23 16:41:18,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] spmStart polling started: taskId = 132da785-a82c-4c5f-8a36-b041eb930439 >2012-12-23 16:41:28,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [637db870] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:41:28,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-36) [637db870] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:28,749 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] spmStart polling ended: taskId = 132da785-a82c-4c5f-8a36-b041eb930439 task status = finished >2012-12-23 16:41:28,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:28,767 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] spmStart polling ended, spm status: Free >2012-12-23 16:41:28,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [637db870] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=132da785-a82c-4c5f-8a36-b041eb930439), log id: 1f631b42 >2012-12-23 16:41:28,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-36) [637db870] FINISH, HSMClearTaskVDSCommand, log id: 1f631b42 >2012-12-23 16:41:28,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-36) [637db870] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@23929a27, log id: bd1c70f >2012-12-23 16:41:28,789 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-36) [6dc688af] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:41:29,338 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-36) [6dc688af] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:41:39,366 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [7d52c480] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:41:39,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [7d52c480] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:41:39,389 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: e56a738 >2012-12-23 16:41:39,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] spmStart polling started: taskId = 177f5bfc-531c-4a51-b456-c31c84de56bb >2012-12-23 16:41:47,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] XML RPC error in command SetVmTicketVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:41:47,522 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] FINISH, SetVmTicketVDSCommand, log id: 79b2ab2d >2012-12-23 16:41:47,522 ERROR [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] Command org.ovirt.engine.core.bll.SetVmTicketCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSNetworkException: >2012-12-23 16:41:47,528 ERROR [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-7) [336d2b64] Transaction rolled-back for command: org.ovirt.engine.core.bll.SetVmTicketCommand. >2012-12-23 16:41:49,671 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [7d52c480] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:41:49,671 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-4) [7d52c480] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:49,672 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] spmStart polling ended: taskId = 177f5bfc-531c-4a51-b456-c31c84de56bb task status = finished >2012-12-23 16:41:49,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:41:49,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] spmStart polling ended, spm status: Free >2012-12-23 16:41:49,692 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=177f5bfc-531c-4a51-b456-c31c84de56bb), log id: 5f3b75d1 >2012-12-23 16:41:49,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] FINISH, HSMClearTaskVDSCommand, log id: 5f3b75d1 >2012-12-23 16:41:49,726 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-4) [7d52c480] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@64d52f4f, log id: e56a738 >2012-12-23 16:41:49,731 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-4) [68151f40] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:41:49,820 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-4) [68151f40] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:41:50,747 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-21) [43c69eaf] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:41:52,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-15) [54be6429] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:41:54,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-2) [5a8a8965] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:41:56,880 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-96) [3c4d3a5f] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:41:58,951 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-35) [730f1e71] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:41:59,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] hostFromVds::selectedVds - orchid-vds2, spmStatus Free, storage pool DC31-CLI >2012-12-23 16:41:59,876 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [561dda9] starting spm on vds orchid-vds2, storage pool DC31-CLI, prevId -1, LVER -1 >2012-12-23 16:41:59,880 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] START, SpmStartVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, prevId=-1, prevLVER=-1, storagePoolFormatType=V3, recoveryMode=Manual, SCSIFencing=false), log id: 3b2b2b90 >2012-12-23 16:41:59,903 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] spmStart polling started: taskId = dc583c3b-ab8f-4a85-b3fc-c1bfe9eddf26 >2012-12-23 16:42:01,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-44) [5a8fa6d6] XML RPC error in command GetCapabilitiesVDS ( HostName = orchid-vds1 ), the error was: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException, SocketException: Connection reset >2012-12-23 16:42:03,547 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (QuartzScheduler_Worker-19) [7547d051] Running command: InitVdsOnUpCommand internal: true. >2012-12-23 16:42:03,663 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] START, ValidateStorageServerConnectionVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 3c6e3353 >2012-12-23 16:42:03,685 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] FINISH, ValidateStorageServerConnectionVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 3c6e3353 >2012-12-23 16:42:03,685 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-19) [91b05dd] Running command: ConnectHostToStoragePoolServersCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:42:03,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] START, ConnectStorageServerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, storageType = NFS, connectionList = [{ id: 3b06cfad-8082-4dc5-bca2-89d4062feda4, connection: orion.qa.lab.tlv.redhat.com:/export/meni/dc31-cli, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };{ id: 8b802963-7cbb-49ad-837f-b3ece33d1490, connection: lion.qa.lab.tlv.redhat.com:/exports/shared_iso_domain1, iqn: null, vfsType: null, mountOptions: null, nfsVersion: null, nfsRetrans: null, nfsTimeo: null };]), log id: 33369be9 >2012-12-23 16:42:03,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] FINISH, ConnectStorageServerVDSCommand, return: {3b06cfad-8082-4dc5-bca2-89d4062feda4=0, 8b802963-7cbb-49ad-837f-b3ece33d1490=0}, log id: 33369be9 >2012-12-23 16:42:03,713 INFO [org.ovirt.engine.core.bll.storage.ConnectHostToStoragePoolServersCommand] (QuartzScheduler_Worker-19) [91b05dd] Host orchid-vds1 storage connection was succeeded >2012-12-23 16:42:03,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] START, ConnectStoragePoolVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, vds_spm_id = 1, masterDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, masterVersion = 1), log id: 4920676d >2012-12-23 16:42:03,804 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand] (QuartzScheduler_Worker-19) [91b05dd] FINISH, ConnectStoragePoolVDSCommand, log id: 4920676d >2012-12-23 16:42:03,841 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (QuartzScheduler_Worker-19) [91b05dd] No string for UNASSIGNED type. Use default Log >2012-12-23 16:42:03,843 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-50) [91b05dd] MultipleActionsRunner of type MigrateVmToServer invoked with no actions >2012-12-23 16:42:03,862 INFO [org.ovirt.engine.core.bll.HandleVdsCpuFlagsOrClusterChangedCommand] (QuartzScheduler_Worker-19) [7bec550b] Running command: HandleVdsCpuFlagsOrClusterChangedCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 16:42:03,997 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (QuartzScheduler_Worker-19) [3d81b575] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 1ea924d8-49a9-11e2-bbf4-001122334455 Type: VDS >2012-12-23 16:42:10,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [561dda9] Failed in HSMGetTaskStatusVDS method >2012-12-23 16:42:10,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-52) [561dda9] Error code AcquireLockFailure and error message VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:42:10,155 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] spmStart polling ended: taskId = dc583c3b-ab8f-4a85-b3fc-c1bfe9eddf26 task status = finished >2012-12-23 16:42:10,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] Start SPM Task failed - result: cleanSuccess, message: VDSGenericException: VDSErrorException: Failed to HSMGetTaskStatusVDS, error = Cannot obtain lock >2012-12-23 16:42:10,173 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] spmStart polling ended, spm status: Free >2012-12-23 16:42:10,190 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [561dda9] START, HSMClearTaskVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, taskId=dc583c3b-ab8f-4a85-b3fc-c1bfe9eddf26), log id: 467c9ad4 >2012-12-23 16:42:10,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (QuartzScheduler_Worker-52) [561dda9] FINISH, HSMClearTaskVDSCommand, log id: 467c9ad4 >2012-12-23 16:42:10,210 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStartVDSCommand] (QuartzScheduler_Worker-52) [561dda9] FINISH, SpmStartVDSCommand, return: org.ovirt.engine.core.common.businessentities.SpmStatusResult@d9885d0, log id: 3b2b2b90 >2012-12-23 16:42:10,212 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-52) [187921a9] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:42:10,244 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [187921a9] IrsBroker::Failed::GetStoragePoolInfoVDS due to: IrsSpmStartFailedException: IRSGenericException: IRSErrorException: SpmStart failed >2012-12-23 16:42:10,263 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [187921a9] Irs placed on server null failed. Proceed Failover >2012-12-23 16:42:10,286 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [187921a9] hostFromVds::selectedVds - orchid-vds1, spmStatus SPM, storage pool DC31-CLI >2012-12-23 16:42:10,297 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (QuartzScheduler_Worker-52) [187921a9] Initialize Irs proxy from vds: orchid-vds1.qa.lab.tlv.redhat.com >2012-12-23 16:42:10,326 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-64) [542bc6ff] START, SPMGetAllTasksInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: d4e16b5 >2012-12-23 16:42:10,413 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-64) [542bc6ff] -- SPMGetAllTasksInfoVDSCommand::ExecuteIrsBrokerCommand: Attempting on storage pool 4027fdea-c811-4bf2-b779-25dbdcacbea5 >2012-12-23 16:42:10,414 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-64) [542bc6ff] START, HSMGetAllTasksInfoVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455), log id: 79fe6236 >2012-12-23 16:42:10,434 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-64) [542bc6ff] FINISH, HSMGetAllTasksInfoVDSCommand, return: [], log id: 79fe6236 >2012-12-23 16:42:10,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksInfoVDSCommand] (QuartzScheduler_Worker-64) [542bc6ff] FINISH, SPMGetAllTasksInfoVDSCommand, return: [], log id: d4e16b5 >2012-12-23 16:42:10,434 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-64) [542bc6ff] Discovered no tasks on Storage Pool DC31-CLI >2012-12-23 16:42:21,062 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-14) [7a677b67] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:42:21,066 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [7a677b67] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, ticket=/qj+24faoJi2, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 7e90c9f3 >2012-12-23 16:42:21,181 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-14) [7a677b67] FINISH, SetVmTicketVDSCommand, log id: 7e90c9f3 >2012-12-23 16:43:03,211 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-10) [1b494897] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:03,216 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [1b494897] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 5c9df96 >2012-12-23 16:43:17,148 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [2b6aa7dc] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:17,151 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [2b6aa7dc] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 5751a453 >2012-12-23 16:43:18,502 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-44) [19a2337f] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:18,511 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-44) [19a2337f] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4fd84c92 >2012-12-23 16:43:19,036 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-42) [688e6703] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,038 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-42) [688e6703] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 6fef1ecd >2012-12-23 16:43:19,204 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-40) [766bab92] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,206 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-40) [766bab92] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 34d60f84 >2012-12-23 16:43:19,398 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-38) [69037438] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,400 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-38) [69037438] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 81cd96d >2012-12-23 16:43:19,572 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-36) [1c675bcd] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-36) [1c675bcd] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4f4061ad >2012-12-23 16:43:19,750 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-34) [6ea7e418] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,752 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-34) [6ea7e418] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 1609b569 >2012-12-23 16:43:19,920 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-32) [2f85a7e6] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:19,922 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-32) [2f85a7e6] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 42afec50 >2012-12-23 16:43:20,092 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-30) [74d08ee] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:20,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-30) [74d08ee] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 376cd911 >2012-12-23 16:43:20,279 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-28) [11f7c53e] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:20,282 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-28) [11f7c53e] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 215e3e71 >2012-12-23 16:43:20,462 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-26) [74b566d0] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:20,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-26) [74b566d0] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4747ebe6 >2012-12-23 16:43:20,639 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-24) [33b491b8] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:20,641 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-24) [33b491b8] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 27cbf92e >2012-12-23 16:43:20,832 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-22) [4dd95b79] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:20,834 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-22) [4dd95b79] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4b5ab0ee >2012-12-23 16:43:21,023 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-20) [271d637d] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:21,026 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-20) [271d637d] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 158bce7c >2012-12-23 16:43:21,212 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-18) [9ed1582] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:21,214 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-18) [9ed1582] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 1c916a5d >2012-12-23 16:43:21,404 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-16) [1686e6bc] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:21,406 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-16) [1686e6bc] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 61624d40 >2012-12-23 16:43:21,589 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-14) [31976c2f] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:21,592 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-14) [31976c2f] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 60a6cdb7 >2012-12-23 16:43:21,791 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-12) [677ac7a2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:21,794 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-12) [677ac7a2] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 6a6f5640 >2012-12-23 16:43:55,399 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-8) [59cdcdd9] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:43:55,401 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-8) [59cdcdd9] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 5c7ef1c7 >2012-12-23 16:44:31,647 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-7) [48d1f3a0] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:44:31,649 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-7) [48d1f3a0] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4201234b >2012-12-23 16:45:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2209bdf5] Checking autorecoverable hosts >2012-12-23 16:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2209bdf5] Autorecovering 0 hosts >2012-12-23 16:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2209bdf5] Checking autorecoverable hosts done >2012-12-23 16:45:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-65) [2209bdf5] Autorecovering storage domains is disabled, skipping >2012-12-23 16:45:08,530 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-4) [4ccbceec] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:08,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [4ccbceec] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:55, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 38a895fd >2012-12-23 16:45:24,185 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-4) [43b96311] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:24,186 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-4) [43b96311] MacPoolManager::allocateNewMac entered >2012-12-23 16:45:24,186 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-4) [43b96311] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:59 >2012-12-23 16:45:24,371 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-4) [5ca01d77] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:24,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-4) [5ca01d77] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=7a362e36-d6b9-47b6-a9e9-1c0f33d6f3b3, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=7a362e36-d6b9-47b6-a9e9-1c0f33d6f3b3, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 3c6545de >2012-12-23 16:45:30,563 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand] (QuartzScheduler_Worker-43) [6e102dbe] XML RPC error in command SpmStatusVDS ( ), the error was: java.util.concurrent.TimeoutException, TimeoutException: >2012-12-23 16:45:30,567 INFO [org.ovirt.engine.core.bll.storage.SetStoragePoolStatusCommand] (QuartzScheduler_Worker-43) [457d0490] Running command: SetStoragePoolStatusCommand internal: true. Entities affected : ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:45:31,056 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-10) [1b494897] FINISH, HotUnplugNicVDSCommand, log id: 5c9df96 >2012-12-23 16:45:31,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [2b6aa7dc] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-47) [2b6aa7dc] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,076 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-47) [2b6aa7dc] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,076 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-47) [2b6aa7dc] FINISH, HotUnplugNicVDSCommand, log id: 5751a453 >2012-12-23 16:45:31,076 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-47) [2b6aa7dc] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [19a2337f] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-44) [19a2337f] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,134 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-44) [19a2337f] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,134 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-44) [19a2337f] FINISH, HotUnplugNicVDSCommand, log id: 4fd84c92 >2012-12-23 16:45:31,134 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-44) [19a2337f] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-42) [688e6703] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-42) [688e6703] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,165 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-42) [688e6703] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,165 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-42) [688e6703] FINISH, HotUnplugNicVDSCommand, log id: 6fef1ecd >2012-12-23 16:45:31,165 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-42) [688e6703] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-40) [766bab92] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-40) [766bab92] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,191 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-40) [766bab92] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,191 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-40) [766bab92] FINISH, HotUnplugNicVDSCommand, log id: 34d60f84 >2012-12-23 16:45:31,191 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-40) [766bab92] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-38) [69037438] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-38) [69037438] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,212 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-38) [69037438] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,212 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-38) [69037438] FINISH, HotUnplugNicVDSCommand, log id: 81cd96d >2012-12-23 16:45:31,212 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-38) [69037438] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-36) [1c675bcd] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-36) [1c675bcd] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,232 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-36) [1c675bcd] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-36) [1c675bcd] FINISH, HotUnplugNicVDSCommand, log id: 4f4061ad >2012-12-23 16:45:31,232 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-36) [1c675bcd] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-34) [6ea7e418] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,258 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-34) [6ea7e418] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,258 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-34) [6ea7e418] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,258 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-34) [6ea7e418] FINISH, HotUnplugNicVDSCommand, log id: 1609b569 >2012-12-23 16:45:31,258 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-34) [6ea7e418] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,279 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-32) [2f85a7e6] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,279 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-32) [2f85a7e6] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,279 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-32) [2f85a7e6] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,279 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-32) [2f85a7e6] FINISH, HotUnplugNicVDSCommand, log id: 42afec50 >2012-12-23 16:45:31,280 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-32) [2f85a7e6] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-30) [74d08ee] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,301 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-30) [74d08ee] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,301 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-30) [74d08ee] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,301 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-30) [74d08ee] FINISH, HotUnplugNicVDSCommand, log id: 376cd911 >2012-12-23 16:45:31,301 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-30) [74d08ee] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-28) [11f7c53e] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,323 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-28) [11f7c53e] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,323 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-28) [11f7c53e] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,323 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-28) [11f7c53e] FINISH, HotUnplugNicVDSCommand, log id: 215e3e71 >2012-12-23 16:45:31,323 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-28) [11f7c53e] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-26) [74b566d0] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,344 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-26) [74b566d0] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,344 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-26) [74b566d0] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-26) [74b566d0] FINISH, HotUnplugNicVDSCommand, log id: 4747ebe6 >2012-12-23 16:45:31,344 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-26) [74b566d0] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-24) [33b491b8] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-24) [33b491b8] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,382 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-24) [33b491b8] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,382 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-24) [33b491b8] FINISH, HotUnplugNicVDSCommand, log id: 27cbf92e >2012-12-23 16:45:31,382 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-24) [33b491b8] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-22) [4dd95b79] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-22) [4dd95b79] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,402 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-22) [4dd95b79] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,402 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-22) [4dd95b79] FINISH, HotUnplugNicVDSCommand, log id: 4b5ab0ee >2012-12-23 16:45:31,403 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-22) [4dd95b79] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-20) [271d637d] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-20) [271d637d] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,423 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-20) [271d637d] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,423 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-20) [271d637d] FINISH, HotUnplugNicVDSCommand, log id: 158bce7c >2012-12-23 16:45:31,424 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-20) [271d637d] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-18) [9ed1582] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-18) [9ed1582] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,444 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-18) [9ed1582] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,444 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-18) [9ed1582] FINISH, HotUnplugNicVDSCommand, log id: 1c916a5d >2012-12-23 16:45:31,444 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-18) [9ed1582] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-16) [1686e6bc] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-16) [1686e6bc] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,464 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-16) [1686e6bc] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,464 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-16) [1686e6bc] FINISH, HotUnplugNicVDSCommand, log id: 61624d40 >2012-12-23 16:45:31,464 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-16) [1686e6bc] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-14) [31976c2f] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-14) [31976c2f] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,485 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-14) [31976c2f] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,485 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-14) [31976c2f] FINISH, HotUnplugNicVDSCommand, log id: 60a6cdb7 >2012-12-23 16:45:31,485 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-14) [31976c2f] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-12) [677ac7a2] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,507 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-12) [677ac7a2] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,508 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-12) [677ac7a2] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,508 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-12) [677ac7a2] FINISH, HotUnplugNicVDSCommand, log id: 6a6f5640 >2012-12-23 16:45:31,508 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-12) [677ac7a2] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-8) [59cdcdd9] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,555 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-8) [59cdcdd9] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,555 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-8) [59cdcdd9] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,555 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-8) [59cdcdd9] FINISH, HotUnplugNicVDSCommand, log id: 5c7ef1c7 >2012-12-23 16:45:31,555 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-8) [59cdcdd9] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [48d1f3a0] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,585 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [48d1f3a0] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,585 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-7) [48d1f3a0] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,585 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-7) [48d1f3a0] FINISH, HotUnplugNicVDSCommand, log id: 4201234b >2012-12-23 16:45:31,585 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-7) [48d1f3a0] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [4ccbceec] Failed in HotUnplugNicVDS method >2012-12-23 16:45:31,608 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [4ccbceec] Error code DEACTIVATE_NIC_FAILED and error message VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,608 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-4) [4ccbceec] Command HotUnplugNicVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,608 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [4ccbceec] FINISH, HotUnplugNicVDSCommand, log id: 38a895fd >2012-12-23 16:45:31,608 ERROR [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-4) [4ccbceec] Command org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand throw Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = NIC not found >2012-12-23 16:45:31,968 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-4) [5ca01d77] FINISH, HotPlugNicVDSCommand, log id: 3c6545de >2012-12-23 16:45:32,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-71) [79368e4f] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: e1ac66c >2012-12-23 16:45:32,774 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-71) [79368e4f] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@53df13b0, log id: e1ac66c >2012-12-23 16:45:32,779 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-71) [79368e4f] VM 80ab027c-2d2a-498a-94ec-bfb290566e65 managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=615b9ec4-a3fc-44a8-9e73-25f7163fc4a7, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x17, function=0x0}, managed=true, plugged=false, readOnly=false, alias=net0} >2012-12-23 16:45:38,234 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-4) [4cbb07ad] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:38,236 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-4) [4cbb07ad] MacPoolManager::freeMac(mac = 00:11:22:33:44:55) - entered >2012-12-23 16:45:40,188 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-4) [3fd50c02] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:40,390 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [3fd50c02] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=7a362e36-d6b9-47b6-a9e9-1c0f33d6f3b3, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=false, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=7a362e36-d6b9-47b6-a9e9-1c0f33d6f3b3, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x18, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 41b15f8 >2012-12-23 16:45:40,642 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [3fd50c02] FINISH, HotUnplugNicVDSCommand, log id: 41b15f8 >2012-12-23 16:45:44,907 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-3) [85dd385] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:44,909 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-3) [85dd385] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:59) - entered >2012-12-23 16:45:54,039 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-6) [28cff69d] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:45:54,040 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-6) [28cff69d] MacPoolManager::allocateNewMac entered >2012-12-23 16:45:54,040 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-6) [28cff69d] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:59 >2012-12-23 16:45:54,231 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-6) [1a10c75d] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:45:54,233 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-6) [1a10c75d] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=67987e42-3683-4c1d-8d5e-60d02b5fc424, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=67987e42-3683-4c1d-8d5e-60d02b5fc424, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 5c0cbdb2 >2012-12-23 16:45:54,712 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-6) [1a10c75d] FINISH, HotPlugNicVDSCommand, log id: 5c0cbdb2 >2012-12-23 16:46:03,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) [533236ab] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 18e70dc7 >2012-12-23 16:46:03,806 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-31) [533236ab] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@69399096, log id: 18e70dc7 >2012-12-23 16:49:33,654 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-3) [66c72038] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:49:33,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-3) [66c72038] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=67987e42-3683-4c1d-8d5e-60d02b5fc424, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=67987e42-3683-4c1d-8d5e-60d02b5fc424, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x19, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 7166ca68 >2012-12-23 16:49:34,006 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-3) [66c72038] FINISH, HotUnplugNicVDSCommand, log id: 7166ca68 >2012-12-23 16:49:39,273 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-3) [57e13d3d] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:49:39,280 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-3) [57e13d3d] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:59) - entered >2012-12-23 16:50:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [2c0e69a9] Checking autorecoverable hosts >2012-12-23 16:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [2c0e69a9] Autorecovering 0 hosts >2012-12-23 16:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [2c0e69a9] Checking autorecoverable hosts done >2012-12-23 16:50:00,004 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-3) [2c0e69a9] Autorecovering storage domains is disabled, skipping >2012-12-23 16:50:03,599 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [5d2130d3] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:50:03,669 WARN [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-10) [e827f73] CanDoAction of action ActivateDeactivateVmNic failed. Reasons:VAR__ACTION__ACTIVATE,VAR__TYPE__INTERFACE,ACTIVATE_DEACTIVATE_NETWORK_NOT_IN_VDS >2012-12-23 16:50:03,686 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [e827f73] Command [id=db88fed3-6140-4fa5-8c47-60154460651b]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmDevice; snapshot: deviceId = 2b4df66c-d40f-4614-8e89-2cf5c5e532c0, vmId = 80ab027c-2d2a-498a-94ec-bfb290566e65. >2012-12-23 16:50:03,688 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [e827f73] Command [id=db88fed3-6140-4fa5-8c47-60154460651b]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkStatistics; snapshot: 2b4df66c-d40f-4614-8e89-2cf5c5e532c0. >2012-12-23 16:50:03,689 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-10) [e827f73] Command [id=db88fed3-6140-4fa5-8c47-60154460651b]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkInterface; snapshot: 2b4df66c-d40f-4614-8e89-2cf5c5e532c0. >2012-12-23 16:50:10,587 WARN [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-4) [3985af54] CanDoAction of action AddVmInterface failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__INTERFACE,NETWORK_MAC_ADDRESS_IN_USE >2012-12-23 16:50:42,299 WARN [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-2) [39f02cfe] CanDoAction of action AddVmInterface failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__INTERFACE,NETWORK_MAC_ADDRESS_IN_USE >2012-12-23 16:51:03,389 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [634c7865] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:51:03,471 WARN [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-7) [19c26122] CanDoAction of action ActivateDeactivateVmNic failed. Reasons:VAR__ACTION__ACTIVATE,VAR__TYPE__INTERFACE,ACTIVATE_DEACTIVATE_NETWORK_NOT_IN_VDS >2012-12-23 16:51:03,474 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [19c26122] Command [id=83750dd3-cd9f-4e22-a5af-03e11a84f01e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmDevice; snapshot: deviceId = 3411d9ea-1393-4802-9a3e-cbd6a503af6e, vmId = 80ab027c-2d2a-498a-94ec-bfb290566e65. >2012-12-23 16:51:03,475 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [19c26122] Command [id=83750dd3-cd9f-4e22-a5af-03e11a84f01e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkStatistics; snapshot: 3411d9ea-1393-4802-9a3e-cbd6a503af6e. >2012-12-23 16:51:03,476 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-7) [19c26122] Command [id=83750dd3-cd9f-4e22-a5af-03e11a84f01e]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkInterface; snapshot: 3411d9ea-1393-4802-9a3e-cbd6a503af6e. >2012-12-23 16:51:10,602 WARN [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-2) [aec7a7c] CanDoAction of action AddVmInterface failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__INTERFACE,NETWORK_MAC_ADDRESS_IN_USE >2012-12-23 16:51:23,986 WARN [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-14) [71a4fd52] CanDoAction of action AddVmInterface failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__INTERFACE,NETWORK_MAC_ADDRESS_IN_USE >2012-12-23 16:51:29,288 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-9) [5b58370b] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:51:29,376 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-9) [23e23316] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:51:29,378 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [23e23316] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=888dc36a-fa80-4ea7-b111-8cbab9058f43, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:11, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=888dc36a-fa80-4ea7-b111-8cbab9058f43, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 295b2827 >2012-12-23 16:51:29,871 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-9) [23e23316] FINISH, HotPlugNicVDSCommand, log id: 295b2827 >2012-12-23 16:51:38,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) [2046e8ae] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 3c0e809f >2012-12-23 16:51:38,131 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) [2046e8ae] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@476e92eb, log id: 3c0e809f >2012-12-23 16:55:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [5a8fa6d6] Checking autorecoverable hosts >2012-12-23 16:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [5a8fa6d6] Autorecovering 0 hosts >2012-12-23 16:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [5a8fa6d6] Checking autorecoverable hosts done >2012-12-23 16:55:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-44) [5a8fa6d6] Autorecovering storage domains is disabled, skipping >2012-12-23 16:55:45,754 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-1) [1a2bbc9d] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM, ID: 4027fdea-c811-4bf2-b779-25dbdcacbea5 Type: StoragePool >2012-12-23 16:55:45,816 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-1) [3aad40e1] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:55:45,818 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-1) [3aad40e1] START, HotPlugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=0bbe6a57-8cb4-45f6-83e6-5f612b2cb847, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:11:22:33:44:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=0bbe6a57-8cb4-45f6-83e6-5f612b2cb847, device=bridge, type=interface, bootOrder=0, specParams={}, address=, managed=true, plugged=true, readOnly=false, alias=}), log id: 1899a873 >2012-12-23 16:55:46,276 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugNicVDSCommand] (ajp-/127.0.0.1:8702-1) [3aad40e1] FINISH, HotPlugNicVDSCommand, log id: 1899a873 >2012-12-23 16:55:47,937 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-74) [463a2aad] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 61d4de27 >2012-12-23 16:55:47,956 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-74) [463a2aad] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5e45049e, log id: 61d4de27 >2012-12-23 16:55:49,130 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-4) [55515203] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:55:49,133 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [55515203] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=888dc36a-fa80-4ea7-b111-8cbab9058f43, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:11:22:33:44:11, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=888dc36a-fa80-4ea7-b111-8cbab9058f43, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x1a, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 48527484 >2012-12-23 16:55:49,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-4) [55515203] FINISH, HotUnplugNicVDSCommand, log id: 48527484 >2012-12-23 16:55:58,769 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-3) [6c9597d2] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:55:58,771 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-3) [6c9597d2] MacPoolManager::freeMac(mac = 00:11:22:33:44:11) - entered >2012-12-23 16:57:05,663 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-48) [2305863] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:57:05,666 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-48) [2305863] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=vm1, nic=VmNetworkInterface {id=0bbe6a57-8cb4-45f6-83e6-5f612b2cb847, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:11:22:33:44:59, active=true, portMirroring=true, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, vmName=vm1, vmTemplateId=null}, vmDevice=VmDevice {vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, deviceId=0bbe6a57-8cb4-45f6-83e6-5f612b2cb847, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x1b, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net1}), log id: 61ab041 >2012-12-23 16:57:06,049 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-48) [2305863] FINISH, HotUnplugNicVDSCommand, log id: 61ab041 >2012-12-23 16:57:10,907 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-3) [244c9fc0] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:57:10,910 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-3) [244c9fc0] MacPoolManager::freeMac(mac = 00:11:22:33:44:59) - entered >2012-12-23 16:57:10,917 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-61) [5ead9898] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 37d789c8 >2012-12-23 16:57:10,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-61) [5ead9898] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2a99c66a, log id: 37d789c8 >2012-12-23 16:57:20,415 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-3) Start time: 12/23/12 4:57 PM. Start running CanDoAction for command number 1/4 (Command type: MigrateVm) >2012-12-23 16:57:20,416 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) Start time: 12/23/12 4:57 PM. Start running CanDoAction for command number 2/4 (Command type: MigrateVm) >2012-12-23 16:57:20,424 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-4) Start time: 12/23/12 4:57 PM. Start running CanDoAction for command number 3/4 (Command type: MigrateVm) >2012-12-23 16:57:20,427 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-7) Start time: 12/23/12 4:57 PM. Start running CanDoAction for command number 4/4 (Command type: MigrateVm) >2012-12-23 16:57:20,544 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-48) End time: 12/23/12 4:57 PM. Finish handling CanDoAction for command number 2/4 (Command type: MigrateVm) >2012-12-23 16:57:20,547 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-3) End time: 12/23/12 4:57 PM. Finish handling CanDoAction for command number 1/4 (Command type: MigrateVm) >2012-12-23 16:57:20,549 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-4) End time: 12/23/12 4:57 PM. Finish handling CanDoAction for command number 3/4 (Command type: MigrateVm) >2012-12-23 16:57:21,095 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-3-thread-7) End time: 12/23/12 4:57 PM. Finish handling CanDoAction for command number 4/4 (Command type: MigrateVm) >2012-12-23 16:57:21,244 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [34ca3d8b] Running command: MigrateVmCommand internal: false. Entities affected : ID: 2e79d247-3ef0-4fc5-b865-ed1092c89a89 Type: VM >2012-12-23 16:57:21,295 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [34ca3d8b] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 4ecf1e8b >2012-12-23 16:57:21,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [34ca3d8b] VdsBroker::migrate::Entered (vm_guid=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 16:57:21,298 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [34ca3d8b] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 6a4299d >2012-12-23 16:57:21,318 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [34ca3d8b] FINISH, MigrateBrokerVDSCommand, log id: 6a4299d >2012-12-23 16:57:21,359 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [34ca3d8b] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4ecf1e8b >2012-12-23 16:57:21,728 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [52a787fc] Running command: MigrateVmCommand internal: false. Entities affected : ID: 22ee2cb6-d617-44ce-b650-d16607825589 Type: VM >2012-12-23 16:57:21,738 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [52a787fc] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 5a13b76f >2012-12-23 16:57:21,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [52a787fc] VdsBroker::migrate::Entered (vm_guid=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 16:57:21,784 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [52a787fc] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 679009b7 >2012-12-23 16:57:21,807 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [52a787fc] FINISH, MigrateBrokerVDSCommand, log id: 679009b7 >2012-12-23 16:57:21,823 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [52a787fc] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 5a13b76f >2012-12-23 16:57:21,963 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [17911703] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 16:57:21,972 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [17911703] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 4a8f99b1 >2012-12-23 16:57:21,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [17911703] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 16:57:21,973 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [17911703] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 3b527b7f >2012-12-23 16:57:21,994 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [17911703] FINISH, MigrateBrokerVDSCommand, log id: 3b527b7f >2012-12-23 16:57:22,011 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [17911703] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 4a8f99b1 >2012-12-23 16:57:22,282 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [28b6f8ed] Running command: MigrateVmCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 16:57:22,292 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [28b6f8ed] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 52952319 >2012-12-23 16:57:22,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [28b6f8ed] VdsBroker::migrate::Entered (vm_guid=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 16:57:22,293 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [28b6f8ed] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 2355a5d >2012-12-23 16:57:22,312 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [28b6f8ed] FINISH, MigrateBrokerVDSCommand, log id: 2355a5d >2012-12-23 16:57:22,328 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [28b6f8ed] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 52952319 >2012-12-23 16:57:22,470 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) [23e647cb] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:22,471 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-39) [23e647cb] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:24,551 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) [7d112234] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:24,554 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-75) [7d112234] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:26,620 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) [2046e8ae] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:26,620 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) [2046e8ae] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:28,684 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) [228ec463] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:28,689 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-6) [228ec463] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:30,754 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) [2a5bad0] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:30,755 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-40) [2a5bad0] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:31,970 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-49) [32f29eff] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 7b4bd300 >2012-12-23 16:57:31,997 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-49) [32f29eff] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2f09e43d, log id: 7b4bd300 >2012-12-23 16:57:32,930 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-12) [9c6c7f1] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:32,931 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-12) [9c6c7f1] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:35,000 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-63) [1e16368b] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:35,001 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-63) [1e16368b] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:37,067 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) [7cb8f567] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:37,068 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-1) [7cb8f567] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:39,144 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-60) [214a09eb] vds::refreshVmList vm id 22ee2cb6-d617-44ce-b650-d16607825589 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:39,145 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-60) [214a09eb] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:40,913 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-67) [4a6ef728] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=22ee2cb6-d617-44ce-b650-d16607825589, force=false, secondsToWait=0, gracefully=false), log id: 41e4afbf >2012-12-23 16:57:41,009 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-67) [4a6ef728] FINISH, DestroyVDSCommand, log id: 41e4afbf >2012-12-23 16:57:41,010 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-67) [4a6ef728] Setting VM vm3 22ee2cb6-d617-44ce-b650-d16607825589 to status unknown >2012-12-23 16:57:41,011 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-67) [4a6ef728] vm vm3 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 16:57:41,086 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) [4411486f] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:41,096 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-62) [4411486f] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:41,097 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-62) [4411486f] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[22ee2cb6-d617-44ce-b650-d16607825589]), log id: 7773f9ee >2012-12-23 16:57:41,118 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-62) [4411486f] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5f1db586, log id: 7773f9ee >2012-12-23 16:57:41,872 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) [58235b1f] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:41,873 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) [58235b1f] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:43,941 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) [47c4e4fa] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:43,941 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-17) [47c4e4fa] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:46,005 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-46) [29025e4b] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:46,006 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-46) [29025e4b] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:48,067 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) [6a9b590e] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:48,068 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) [6a9b590e] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:50,132 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) [223ea66] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:50,134 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-73) [223ea66] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:52,337 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) [3d4c3194] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:52,338 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-87) [3d4c3194] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:54,402 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) [3207c72e] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:54,403 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-90) [3207c72e] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:56,470 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) [c51e101] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:56,470 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) [c51e101] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:58,540 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) [2e2a8928] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:57:58,541 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-83) [2e2a8928] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 193dd3ca >2012-12-23 16:57:58,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-83) [2e2a8928] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2a1b7fb8, log id: 193dd3ca >2012-12-23 16:57:59,268 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-68) [128b3ba1] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 3f55df8c >2012-12-23 16:57:59,355 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-68) [128b3ba1] FINISH, DestroyVDSCommand, log id: 3f55df8c >2012-12-23 16:57:59,464 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [128b3ba1] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 status = Down on vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 16:57:59,465 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [128b3ba1] VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from MigratingFrom --> Up >2012-12-23 16:57:59,465 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [128b3ba1] adding VM 80ab027c-2d2a-498a-94ec-bfb290566e65 to re-run list >2012-12-23 16:57:59,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-68) [128b3ba1] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 68ccd85e >2012-12-23 16:57:59,490 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-68) [128b3ba1] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@60913912, log id: 68ccd85e >2012-12-23 16:57:59,628 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-68) [128b3ba1] Rerun vm 80ab027c-2d2a-498a-94ec-bfb290566e65. Called from vds orchid-vds1 >2012-12-23 16:57:59,634 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-7) [128b3ba1] START, MigrateStatusVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65), log id: 7e1d0351 >2012-12-23 16:57:59,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [128b3ba1] Failed in MigrateStatusVDS method >2012-12-23 16:57:59,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [128b3ba1] Error code migrateErr and error message VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 16:57:59,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [128b3ba1] Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 12 >mMessage Fatal error during migration > > >2012-12-23 16:57:59,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [128b3ba1] HostName = orchid-vds1 >2012-12-23 16:57:59,674 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-7) [128b3ba1] Command MigrateStatusVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 16:57:59,674 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-7) [128b3ba1] FINISH, MigrateStatusVDSCommand, log id: 7e1d0351 >2012-12-23 16:57:59,772 INFO [org.ovirt.engine.core.bll.VdsSelector] (pool-3-thread-7) [128b3ba1] VDS orchid-vds2 2d10c76a-49a9-11e2-9ecf-001122334455 have failed running this VM in the current selection cycle >2012-12-23 16:57:59,772 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [128b3ba1] CanDoAction of action MigrateVm failed. Reasons:ACTION_TYPE_FAILED_VDS_VM_CLUSTER,VAR__ACTION__MIGRATE,VAR__TYPE__VM >2012-12-23 16:58:00,867 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-86) [279f0879] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:58:03,268 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-65) [2209bdf5] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:58:05,315 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-7) [1d195445] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:58:07,360 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-78) [3761dec2] vds::refreshVmList vm id 2e79d247-3ef0-4fc5-b865-ed1092c89a89 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 16:58:08,161 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-93) [59c2d803] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=2e79d247-3ef0-4fc5-b865-ed1092c89a89, force=false, secondsToWait=0, gracefully=false), log id: 6cb98dd6 >2012-12-23 16:58:08,232 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-93) [59c2d803] FINISH, DestroyVDSCommand, log id: 6cb98dd6 >2012-12-23 16:58:08,233 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) [59c2d803] Setting VM vm2 2e79d247-3ef0-4fc5-b865-ed1092c89a89 to status unknown >2012-12-23 16:58:08,233 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-93) [59c2d803] vm vm2 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 16:58:08,344 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-3) [2c0e69a9] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[2e79d247-3ef0-4fc5-b865-ed1092c89a89]), log id: 77ada869 >2012-12-23 16:58:08,362 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-3) [2c0e69a9] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6a275757, log id: 77ada869 >2012-12-23 17:00:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58545dc5] Checking autorecoverable hosts >2012-12-23 17:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58545dc5] Autorecovering 0 hosts >2012-12-23 17:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58545dc5] Checking autorecoverable hosts done >2012-12-23 17:00:00,002 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-51) [58545dc5] Autorecovering storage domains is disabled, skipping >2012-12-23 17:05:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [4d37d17b] Checking autorecoverable hosts >2012-12-23 17:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [4d37d17b] Autorecovering 0 hosts >2012-12-23 17:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [4d37d17b] Checking autorecoverable hosts done >2012-12-23 17:05:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-42) [4d37d17b] Autorecovering storage domains is disabled, skipping >2012-12-23 17:05:34,926 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [248453c8] Running command: MigrateVmCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 17:05:34,941 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [248453c8] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: e549b43 >2012-12-23 17:05:34,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [248453c8] VdsBroker::migrate::Entered (vm_guid=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 17:05:34,942 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [248453c8] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 6eace2d7 >2012-12-23 17:05:34,961 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [248453c8] FINISH, MigrateBrokerVDSCommand, log id: 6eace2d7 >2012-12-23 17:05:34,976 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [248453c8] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: e549b43 >2012-12-23 17:05:35,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [324d70a1] Failed in GetVmStatsVDS method >2012-12-23 17:05:35,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [324d70a1] Error code noVM and error message VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2012-12-23 17:05:35,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [324d70a1] Command org.ovirt.engine.core.vdsbroker.vdsbroker.GetVmStatsVDSCommand return value > org.ovirt.engine.core.vdsbroker.vdsbroker.VMInfoListReturnForXmlRpc@7c990aeb >2012-12-23 17:05:35,606 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-27) [324d70a1] HostName = orchid-vds2 >2012-12-23 17:05:35,607 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (QuartzScheduler_Worker-27) [324d70a1] Command GetVmStatsVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmStatsVDS, error = Virtual machine does not exist >2012-12-23 17:05:35,669 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) [2046e8ae] VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from MigratingFrom --> Up >2012-12-23 17:05:35,669 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) [2046e8ae] adding VM 80ab027c-2d2a-498a-94ec-bfb290566e65 to re-run list >2012-12-23 17:05:35,669 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) [2046e8ae] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 286c5430 >2012-12-23 17:05:35,687 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-92) [2046e8ae] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@600b300b, log id: 286c5430 >2012-12-23 17:05:35,764 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-92) [2046e8ae] Rerun vm 80ab027c-2d2a-498a-94ec-bfb290566e65. Called from vds orchid-vds1 >2012-12-23 17:05:35,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-7) [2046e8ae] START, MigrateStatusVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65), log id: 2ebfc14d >2012-12-23 17:05:35,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [2046e8ae] Failed in MigrateStatusVDS method >2012-12-23 17:05:35,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [2046e8ae] Error code migrateErr and error message VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:05:35,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [2046e8ae] Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 12 >mMessage Fatal error during migration > > >2012-12-23 17:05:35,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-7) [2046e8ae] HostName = orchid-vds1 >2012-12-23 17:05:35,787 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-7) [2046e8ae] Command MigrateStatusVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:05:35,787 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-7) [2046e8ae] FINISH, MigrateStatusVDSCommand, log id: 2ebfc14d >2012-12-23 17:05:35,898 INFO [org.ovirt.engine.core.bll.VdsSelector] (pool-3-thread-7) [2046e8ae] VDS orchid-vds2 2d10c76a-49a9-11e2-9ecf-001122334455 have failed running this VM in the current selection cycle >2012-12-23 17:05:35,898 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [2046e8ae] CanDoAction of action MigrateVm failed. Reasons:ACTION_TYPE_FAILED_VDS_VM_CLUSTER,VAR__ACTION__MIGRATE,VAR__TYPE__VM >2012-12-23 17:06:50,076 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-3) [43075de2] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 17:06:50,079 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-3) [43075de2] START, HotUnplugNicVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vm.vm_name=vm4, nic=VmNetworkInterface {id=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, networkName=rhevm, speed=1000, type=3, name=nic2, macAddress=00:1a:4a:16:88:52, active=true, portMirroring=false, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, vmName=vm4, vmTemplateId=null}, vmDevice=VmDevice {vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, deviceId=ea1939fe-f01f-46eb-b59f-c907a7b4d1d0, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 5d6361cd >2012-12-23 17:06:50,411 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-3) [43075de2] FINISH, HotUnplugNicVDSCommand, log id: 5d6361cd >2012-12-23 17:06:55,861 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-7) [6d19ff28] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 17:06:55,863 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-7) [6d19ff28] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:52) - entered >2012-12-23 17:07:05,999 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-3) [6ac6c0a5] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 17:07:06,010 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [6ac6c0a5] START, MigrateVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 2c2ea03d >2012-12-23 17:07:06,011 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [6ac6c0a5] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 17:07:06,012 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [6ac6c0a5] START, MigrateBrokerVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds2.qa.lab.tlv.redhat.com, dstVdsId=1ea924d8-49a9-11e2-bbf4-001122334455, dstHost=orchid-vds1.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: da3a856 >2012-12-23 17:07:06,039 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [6ac6c0a5] FINISH, MigrateBrokerVDSCommand, log id: da3a856 >2012-12-23 17:07:06,067 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [6ac6c0a5] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 2c2ea03d >2012-12-23 17:07:06,889 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-8) [525089a3] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:08,958 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-54) [2ccc9ae2] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:11,000 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) [2cfd3156] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:11,277 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-57) [6a9b590e] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 3ce637e9 >2012-12-23 17:07:11,296 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-57) [6a9b590e] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@2e60c13b, log id: 3ce637e9 >2012-12-23 17:07:13,045 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-37) [47af0e0c] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:15,099 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-24) [b81e51c] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:17,317 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-82) [1d688b] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:19,365 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-58) [c51e101] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:21,409 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-83) [2e2a8928] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:23,453 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-86) [279f0879] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds1 ignoring it in the refresh until migration is done >2012-12-23 17:07:25,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-50) [38663b8e] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 4743de81 >2012-12-23 17:07:25,533 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-50) [38663b8e] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@38c50bb4, log id: 4743de81 >2012-12-23 17:07:25,754 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-38) [4f7c234d] START, DestroyVDSCommand(HostName = orchid-vds2, HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 6ff51699 >2012-12-23 17:07:25,834 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-38) [4f7c234d] FINISH, DestroyVDSCommand, log id: 6ff51699 >2012-12-23 17:07:25,863 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-38) [4f7c234d] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 status = Down on vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:02,702 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-3) [1d0be0a] Running command: MigrateVmCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 17:08:02,720 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [1d0be0a] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 26dda7f1 >2012-12-23 17:08:02,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [1d0be0a] VdsBroker::migrate::Entered (vm_guid=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 17:08:02,721 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [1d0be0a] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 6588fac1 >2012-12-23 17:08:02,739 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [1d0be0a] FINISH, MigrateBrokerVDSCommand, log id: 6588fac1 >2012-12-23 17:08:02,785 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [1d0be0a] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 26dda7f1 >2012-12-23 17:08:04,986 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-63) [1e16368b] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:07,050 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-89) [6afe3caf] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:09,093 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-51) [58545dc5] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:11,135 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-67) [4a6ef728] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:13,196 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-11) [58235b1f] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:15,439 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-8) [525089a3] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:17,521 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-46) [29025e4b] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:19,566 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) [2cfd3156] vds::refreshVmList vm id ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:08:20,958 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-57) [6a9b590e] START, DestroyVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6, force=false, secondsToWait=0, gracefully=false), log id: 66823486 >2012-12-23 17:08:21,037 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (QuartzScheduler_Worker-57) [6a9b590e] FINISH, DestroyVDSCommand, log id: 66823486 >2012-12-23 17:08:21,038 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) [6a9b590e] Setting VM vm4 ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 to status unknown >2012-12-23 17:08:21,038 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-57) [6a9b590e] vm vm4 running in db and not running in vds - add to rerun treatment. vds orchid-vds1 >2012-12-23 17:08:21,086 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-98) [7293564f] START, FullListVdsCommand( HostId = 2d10c76a-49a9-11e2-9ecf-001122334455, vds=null, vmIds=[ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6]), log id: 4a2126d0 >2012-12-23 17:08:21,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-98) [7293564f] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@467b47b5, log id: 4a2126d0 >2012-12-23 17:08:58,231 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-3) [3e30f4fb] Running command: MigrateVmCommand internal: false. Entities affected : ID: 80ab027c-2d2a-498a-94ec-bfb290566e65 Type: VM >2012-12-23 17:08:58,241 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [3e30f4fb] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 30d3c8c4 >2012-12-23 17:08:58,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [3e30f4fb] VdsBroker::migrate::Entered (vm_guid=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 17:08:58,242 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [3e30f4fb] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 148545d7 >2012-12-23 17:08:58,261 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-3) [3e30f4fb] FINISH, MigrateBrokerVDSCommand, log id: 148545d7 >2012-12-23 17:08:58,301 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-3) [3e30f4fb] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 30d3c8c4 >2012-12-23 17:08:58,788 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-18) [365bec2d] vds::refreshVmList vm id 80ab027c-2d2a-498a-94ec-bfb290566e65 is migrating to vds orchid-vds2 ignoring it in the refresh until migration is done >2012-12-23 17:09:00,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-20) [5e0ee5e7] VM vm1 80ab027c-2d2a-498a-94ec-bfb290566e65 moved from MigratingFrom --> Up >2012-12-23 17:09:00,661 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-20) [5e0ee5e7] adding VM 80ab027c-2d2a-498a-94ec-bfb290566e65 to re-run list >2012-12-23 17:09:00,661 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-20) [5e0ee5e7] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[80ab027c-2d2a-498a-94ec-bfb290566e65]), log id: 729c1e6a >2012-12-23 17:09:00,680 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-20) [5e0ee5e7] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@6790fbee, log id: 729c1e6a >2012-12-23 17:09:00,752 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-20) [5e0ee5e7] Rerun vm 80ab027c-2d2a-498a-94ec-bfb290566e65. Called from vds orchid-vds1 >2012-12-23 17:09:00,777 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-4) [5e0ee5e7] START, MigrateStatusVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=80ab027c-2d2a-498a-94ec-bfb290566e65), log id: 50fdfaa6 >2012-12-23 17:09:00,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [5e0ee5e7] Failed in MigrateStatusVDS method >2012-12-23 17:09:00,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [5e0ee5e7] Error code migrateErr and error message VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:09:00,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [5e0ee5e7] Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 12 >mMessage Fatal error during migration > > >2012-12-23 17:09:00,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-4) [5e0ee5e7] HostName = orchid-vds1 >2012-12-23 17:09:00,795 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-4) [5e0ee5e7] Command MigrateStatusVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:09:00,795 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-4) [5e0ee5e7] FINISH, MigrateStatusVDSCommand, log id: 50fdfaa6 >2012-12-23 17:09:00,880 INFO [org.ovirt.engine.core.bll.VdsSelector] (pool-3-thread-4) [5e0ee5e7] VDS orchid-vds2 2d10c76a-49a9-11e2-9ecf-001122334455 have failed running this VM in the current selection cycle >2012-12-23 17:09:00,881 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-4) [5e0ee5e7] CanDoAction of action MigrateVm failed. Reasons:ACTION_TYPE_FAILED_VDS_VM_CLUSTER,VAR__ACTION__MIGRATE,VAR__TYPE__VM >2012-12-23 17:10:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) [43c69eaf] Checking autorecoverable hosts >2012-12-23 17:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) [43c69eaf] Autorecovering 0 hosts >2012-12-23 17:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) [43c69eaf] Checking autorecoverable hosts done >2012-12-23 17:10:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-21) [43c69eaf] Autorecovering storage domains is disabled, skipping >2012-12-23 17:15:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5e1333e4] Checking autorecoverable hosts >2012-12-23 17:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5e1333e4] Autorecovering 0 hosts >2012-12-23 17:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5e1333e4] Checking autorecoverable hosts done >2012-12-23 17:15:00,003 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-91) [5e1333e4] Autorecovering storage domains is disabled, skipping >2012-12-23 17:18:11,382 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] Lock Acquired to object EngineLock [exclusiveLocks= key: test-vm value: VM_NAME >, sharedLocks= ] >2012-12-23 17:18:11,496 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7125627d >2012-12-23 17:18:11,497 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] FINISH, IsValidVDSCommand, return: true, log id: 7125627d >2012-12-23 17:18:11,523 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] Running command: AddVmFromScratchCommand internal: false. Entities affected : ID: cb4709f4-49a8-11e2-b20a-001122334455 Type: VdsGroups >2012-12-23 17:18:11,524 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 7c4bc139 >2012-12-23 17:18:11,525 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] FINISH, IsValidVDSCommand, return: true, log id: 7c4bc139 >2012-12-23 17:18:11,576 INFO [org.ovirt.engine.core.bll.AddVmFromScratchCommand] (ajp-/127.0.0.1:8702-14) [15d1a0d] Lock freed to object EngineLock [exclusiveLocks= key: test-vm value: VM_NAME >, sharedLocks= ] >2012-12-23 17:18:16,475 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-6) [7e8f151f] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:18:16,475 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-6) [7e8f151f] MacPoolManager::allocateNewMac entered >2012-12-23 17:18:16,475 INFO [org.ovirt.engine.core.bll.MacPoolManager] (ajp-/127.0.0.1:8702-6) [7e8f151f] MacPoolManager::allocateNewMac allocated mac = 00:1a:4a:16:88:59 >2012-12-23 17:18:16,545 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-6) [d9736bb] Running command: ActivateDeactivateVmNicCommand internal: true. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:18:19,586 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-6) [17082121] Lock Acquired to object EngineLock [exclusiveLocks= key: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c value: VM_DISK_BOOT >, sharedLocks= key: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c value: VM >] >2012-12-23 17:18:19,606 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-6) [17082121] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: cef117f >2012-12-23 17:18:19,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-6) [17082121] FINISH, IsValidVDSCommand, return: true, log id: cef117f >2012-12-23 17:18:19,648 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (ajp-/127.0.0.1:8702-6) [17082121] Running command: AddDiskCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM, ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 17:18:19,966 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] Running command: AddImageFromScratchCommand internal: true. Entities affected : ID: 7ce7e233-140b-4086-8fbb-a81247665e51 Type: Storage >2012-12-23 17:18:20,010 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] Lock freed to object EngineLock [exclusiveLocks= key: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c value: VM_DISK_BOOT >, sharedLocks= key: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c value: VM >] >2012-12-23 17:18:20,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] START, CreateImageVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = 3.1, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 0bec1b53-afba-4365-a237-7d3517e470a6, imageSizeInBytes = 1073741824, volumeFormat = RAW, newImageId = 20010326-c0fa-4dce-9cf7-dc5a75af0de1, newImageDescription = ), log id: 58f47c3d >2012-12-23 17:18:20,012 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] -- CreateImageVDSCommand::ExecuteIrsBrokerCommand: calling 'createVolume' with two new parameters: description and UUID >2012-12-23 17:18:20,013 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] -- createVolume parameters: > sdUUID=7ce7e233-140b-4086-8fbb-a81247665e51 > spUUID=4027fdea-c811-4bf2-b779-25dbdcacbea5 > imgGUID=0bec1b53-afba-4365-a237-7d3517e470a6 > size=1,073,741,824 bytes > volFormat=RAW > volType=Sparse > volUUID=20010326-c0fa-4dce-9cf7-dc5a75af0de1 > descr= > srcImgGUID=00000000-0000-0000-0000-000000000000 > srcVolUUID=00000000-0000-0000-0000-000000000000 > >2012-12-23 17:18:20,234 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] FINISH, CreateImageVDSCommand, return: 20010326-c0fa-4dce-9cf7-dc5a75af0de1, log id: 58f47c3d >2012-12-23 17:18:20,283 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] EntityAsyncTask::Adding EntityMultiAsyncTasks object for entity 0bec1b53-afba-4365-a237-7d3517e470a6 >2012-12-23 17:18:20,284 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] EntityMultiAsyncTasks::AttachTask: Attaching task 643cb29d-7405-4fd0-9355-38c5c5f757e8 to entity 0bec1b53-afba-4365-a237-7d3517e470a6. >2012-12-23 17:18:20,291 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskUtils] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] Adding task 643cb29d-7405-4fd0-9355-38c5c5f757e8 to DataBase >2012-12-23 17:18:20,466 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] Adding task 643cb29d-7405-4fd0-9355-38c5c5f757e8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. >2012-12-23 17:18:20,645 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] BaseAsyncTask::StartPollingTask: Starting to poll task 643cb29d-7405-4fd0-9355-38c5c5f757e8. >2012-12-23 17:18:20,645 INFO [org.ovirt.engine.core.bll.EntityMultiAsyncTasks] (ajp-/127.0.0.1:8702-6) [1a9ed6b2] EntityMultiAsyncTasks::StartPollingTask: Current Action Type for entity 0bec1b53-afba-4365-a237-7d3517e470a6 is AddDisk (determined by task 643cb29d-7405-4fd0-9355-38c5c5f757e8) >2012-12-23 17:18:25,475 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-20) [5e0ee5e7] Polling and updating Async Tasks: 1 tasks, 1 tasks to poll now >2012-12-23 17:18:25,502 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-20) [5e0ee5e7] SPMAsyncTask::PollTask: Polling task 643cb29d-7405-4fd0-9355-38c5c5f757e8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'success'. >2012-12-23 17:18:25,559 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (QuartzScheduler_Worker-20) [5e0ee5e7] BaseAsyncTask::OnTaskEndSuccess: Task 643cb29d-7405-4fd0-9355-38c5c5f757e8 (Parent Command AddDisk, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended successfully. >2012-12-23 17:18:25,559 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-20) [5e0ee5e7] EntityAsyncTask::EndActionIfNecessary: All tasks of entity 0bec1b53-afba-4365-a237-7d3517e470a6 has ended -> executing EndAction >2012-12-23 17:18:25,560 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (QuartzScheduler_Worker-20) [5e0ee5e7] EntityAsyncTask::EndAction: Ending action for 1 tasks (entity ID: 0bec1b53-afba-4365-a237-7d3517e470a6): calling EndAction for action type AddDisk. >2012-12-23 17:18:25,561 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-3) [5e0ee5e7] EntityAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction AddDisk, executionIndex: 0 >2012-12-23 17:18:25,585 INFO [org.ovirt.engine.core.bll.AddDiskCommand] (pool-3-thread-3) [17082121] Ending command successfully: org.ovirt.engine.core.bll.AddDiskCommand >2012-12-23 17:18:25,585 INFO [org.ovirt.engine.core.bll.AddImageFromScratchCommand] (pool-3-thread-3) [1a9ed6b2] Ending command successfully: org.ovirt.engine.core.bll.AddImageFromScratchCommand >2012-12-23 17:18:25,595 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-3) [1a9ed6b2] START, GetImageInfoVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 7ce7e233-140b-4086-8fbb-a81247665e51, imageGroupId = 0bec1b53-afba-4365-a237-7d3517e470a6, imageId = 20010326-c0fa-4dce-9cf7-dc5a75af0de1), log id: 21e6be95 >2012-12-23 17:18:25,634 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (pool-3-thread-3) [1a9ed6b2] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.DiskImage@91b825e9, log id: 21e6be95 >2012-12-23 17:18:25,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-3) START, UpdateVMVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, storageDomainId = 00000000-0000-0000-0000-000000000000, infoDictionary.size = 1), log id: 3476caf7 >2012-12-23 17:18:25,851 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.UpdateVMVDSCommand] (pool-3-thread-3) FINISH, UpdateVMVDSCommand, log id: 3476caf7 >2012-12-23 17:18:25,906 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-3) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk completed, handling the result. >2012-12-23 17:18:25,906 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-3) EntityAsyncTask::HandleEndActionResult [within thread]: EndAction for action type AddDisk succeeded, clearing tasks. >2012-12-23 17:18:25,942 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-3) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 643cb29d-7405-4fd0-9355-38c5c5f757e8 >2012-12-23 17:18:25,943 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-3) START, SPMClearTaskVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null, taskId = 643cb29d-7405-4fd0-9355-38c5c5f757e8), log id: 7d2952ee >2012-12-23 17:18:25,945 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-3) START, HSMClearTaskVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, taskId=643cb29d-7405-4fd0-9355-38c5c5f757e8), log id: de333f2 >2012-12-23 17:18:25,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-3-thread-3) FINISH, HSMClearTaskVDSCommand, log id: de333f2 >2012-12-23 17:18:25,986 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-3-thread-3) FINISH, SPMClearTaskVDSCommand, log id: 7d2952ee >2012-12-23 17:18:25,999 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-3-thread-3) BaseAsyncTask::RemoveTaskFromDB: Removed task 643cb29d-7405-4fd0-9355-38c5c5f757e8 from DataBase >2012-12-23 17:18:25,999 INFO [org.ovirt.engine.core.bll.EntityAsyncTask] (pool-3-thread-3) EntityAsyncTask::HandleEndActionResult [within thread]: Removing EntityMultiAsyncTasks object for entity 0bec1b53-afba-4365-a237-7d3517e470a6 >2012-12-23 17:18:31,979 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] START, IsValidVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 19fd5a03 >2012-12-23 17:18:31,981 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsValidVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] FINISH, IsValidVDSCommand, return: true, log id: 19fd5a03 >2012-12-23 17:18:32,063 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] START, IsVmDuringInitiatingVDSCommand( vmId = c0c305a3-29c0-48be-b2bc-4ce78d82ac4c), log id: 63fc00d4 >2012-12-23 17:18:32,063 INFO [org.ovirt.engine.core.vdsbroker.IsVmDuringInitiatingVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] FINISH, IsVmDuringInitiatingVDSCommand, return: false, log id: 63fc00d4 >2012-12-23 17:18:32,191 INFO [org.ovirt.engine.core.bll.RunVmOnceCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] Running command: RunVmOnceCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:18:32,238 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] START, IsoPrefixVDSCommand( storagePoolId = 4027fdea-c811-4bf2-b779-25dbdcacbea5, ignoreFailoverLimit = false, compatabilityVersion = null), log id: 5371f8b1 >2012-12-23 17:18:32,298 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IsoPrefixVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] FINISH, IsoPrefixVDSCommand, return: /rhev/data-center/4027fdea-c811-4bf2-b779-25dbdcacbea5/7233a711-98e8-4c3c-bcfa-44c4bcc4f6c6/images/11111111-1111-1111-1111-111111111111, log id: 5371f8b1 >2012-12-23 17:18:32,305 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] START, CreateVmVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, vm=org.ovirt.engine.core.common.businessentities.VM@4b17cf57), log id: 3f244a47 >2012-12-23 17:18:32,319 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] START, CreateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, vm=org.ovirt.engine.core.common.businessentities.VM@4b17cf57), log id: 1dbe1d4a >2012-12-23 17:18:32,425 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand spiceSslCipherSuite=DEFAULT,memSize=512,kvmEnable=true,smp=1,emulatedMachine=rhel6.3.0,vmType=kvm,keyboardLayout=en-us,nice=0,display=qxl,smpCoresPerSocket=1,spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,timeOffset=-43200,transparentHugePages=true,vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c,devices=[Ljava.util.Map;@49008e57,acpiEnable=true,vmName=test-vm,cpuType=Conroe,custom={} >2012-12-23 17:18:32,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] FINISH, CreateVDSCommand, log id: 1dbe1d4a >2012-12-23 17:18:32,431 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] IncreasePendingVms::CreateVmIncreasing vds orchid-vds1 pending vcpu count, now 1. Vm: test-vm >2012-12-23 17:18:32,459 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (ajp-/127.0.0.1:8702-14) [36b8c488] FINISH, CreateVmVDSCommand, return: WaitForLaunch, log id: 3f244a47 >2012-12-23 17:18:34,354 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-64) [542bc6ff] VM test-vm c0c305a3-29c0-48be-b2bc-4ce78d82ac4c moved from WaitForLaunch --> PoweringUp >2012-12-23 17:18:34,354 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [542bc6ff] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[c0c305a3-29c0-48be-b2bc-4ce78d82ac4c]), log id: 2cf7eb76 >2012-12-23 17:18:34,373 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-64) [542bc6ff] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4883a70a, log id: 2cf7eb76 >2012-12-23 17:18:41,695 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (ajp-/127.0.0.1:8702-1) [752a9a4a] Running command: SetVmTicketCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:18:41,698 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [752a9a4a] START, SetVmTicketVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, ticket=7k3K8Lm56Jw9, validTime=120,m userName=admin@internal, userId=fdfc627c-d875-11e0-90f0-83df133b58cc), log id: 1b886726 >2012-12-23 17:18:41,809 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (ajp-/127.0.0.1:8702-1) [752a9a4a] FINISH, SetVmTicketVDSCommand, log id: 1b886726 >2012-12-23 17:19:33,768 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-99) [5cbcd232] VM test-vm c0c305a3-29c0-48be-b2bc-4ce78d82ac4c moved from PoweringUp --> Up >2012-12-23 17:19:34,208 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-99) [5cbcd232] START, UpdateVdsDynamicDataVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vdsDynamic=org.ovirt.engine.core.common.businessentities.VdsDynamic@8120224), log id: 34443de >2012-12-23 17:19:34,222 INFO [org.ovirt.engine.core.vdsbroker.UpdateVdsDynamicDataVDSCommand] (QuartzScheduler_Worker-99) [5cbcd232] FINISH, UpdateVdsDynamicDataVDSCommand, log id: 34443de >2012-12-23 17:19:45,148 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-23) [7ce810ff] Setting new tasks map. The map contains now 0 tasks >2012-12-23 17:19:45,148 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-23) [7ce810ff] Cleared all tasks of pool 4027fdea-c811-4bf2-b779-25dbdcacbea5. >2012-12-23 17:19:45,150 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (QuartzScheduler_Worker-23) [7ce810ff] Could not find vds that is spm and non-operational. >2012-12-23 17:19:46,726 INFO [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (pool-3-thread-7) [5900c8cb] Running command: ActivateDeactivateVmNicCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:19:46,729 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-7) [5900c8cb] START, HotUnplugNicVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vm.vm_name=test-vm, nic=VmNetworkInterface {id=37f0d70e-cef5-4328-920a-e5d8a1d4298b, networkName=rhevm, speed=1000, type=3, name=nic1, macAddress=00:1a:4a:16:88:59, active=true, portMirroring=false, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, vmName=test-vm, vmTemplateId=null}, vmDevice=VmDevice {vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, deviceId=37f0d70e-cef5-4328-920a-e5d8a1d4298b, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=true, readOnly=false, alias=net0}), log id: 4bd47bdb >2012-12-23 17:19:46,953 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotUnplugNicVDSCommand] (pool-3-thread-7) [5900c8cb] FINISH, HotUnplugNicVDSCommand, log id: 4bd47bdb >2012-12-23 17:19:51,407 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-63) [1e16368b] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[c0c305a3-29c0-48be-b2bc-4ce78d82ac4c]), log id: 410f7912 >2012-12-23 17:19:51,426 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-63) [1e16368b] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@5ed5ae1c, log id: 410f7912 >2012-12-23 17:19:51,434 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-63) [1e16368b] VM c0c305a3-29c0-48be-b2bc-4ce78d82ac4c managed non pluggable device was removed unexpectedly from libvirt: VmDevice {vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, deviceId=37f0d70e-cef5-4328-920a-e5d8a1d4298b, device=bridge, type=interface, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x03, function=0x0}, managed=true, plugged=false, readOnly=false, alias=net0} >2012-12-23 17:19:51,911 INFO [org.ovirt.engine.core.bll.RemoveVmInterfaceCommand] (pool-3-thread-3) [6496386f] Running command: RemoveVmInterfaceCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:19:51,913 INFO [org.ovirt.engine.core.bll.MacPoolManager] (pool-3-thread-3) [6496386f] MacPoolManager::freeMac(mac = 00:1a:4a:16:88:59) - entered >2012-12-23 17:20:00,000 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [58235b1f] Checking autorecoverable hosts >2012-12-23 17:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [58235b1f] Autorecovering 0 hosts >2012-12-23 17:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [58235b1f] Checking autorecoverable hosts done >2012-12-23 17:20:00,001 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (QuartzScheduler_Worker-11) [58235b1f] Autorecovering storage domains is disabled, skipping >2012-12-23 17:20:03,528 INFO [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-7) [2db329a0] Running command: MigrateVmCommand internal: false. Entities affected : ID: c0c305a3-29c0-48be-b2bc-4ce78d82ac4c Type: VM >2012-12-23 17:20:03,538 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [2db329a0] START, MigrateVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: 392af55 >2012-12-23 17:20:03,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [2db329a0] VdsBroker::migrate::Entered (vm_guid=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, method=online >2012-12-23 17:20:03,539 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [2db329a0] START, MigrateBrokerVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c, srcHost=orchid-vds1.qa.lab.tlv.redhat.com, dstVdsId=2d10c76a-49a9-11e2-9ecf-001122334455, dstHost=orchid-vds2.qa.lab.tlv.redhat.com:54321, migrationMethod=ONLINE), log id: edf5b0f >2012-12-23 17:20:03,566 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] (pool-3-thread-7) [2db329a0] FINISH, MigrateBrokerVDSCommand, log id: edf5b0f >2012-12-23 17:20:03,602 INFO [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (pool-3-thread-7) [2db329a0] FINISH, MigrateVDSCommand, return: MigratingFrom, log id: 392af55 >2012-12-23 17:20:04,581 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) [2cfd3156] VM test-vm c0c305a3-29c0-48be-b2bc-4ce78d82ac4c moved from MigratingFrom --> Up >2012-12-23 17:20:04,581 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) [2cfd3156] adding VM c0c305a3-29c0-48be-b2bc-4ce78d82ac4c to re-run list >2012-12-23 17:20:04,581 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-72) [2cfd3156] START, FullListVdsCommand( HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vds=null, vmIds=[c0c305a3-29c0-48be-b2bc-4ce78d82ac4c]), log id: 7857425 >2012-12-23 17:20:04,603 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand] (QuartzScheduler_Worker-72) [2cfd3156] FINISH, FullListVdsCommand, return: [Lorg.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcStruct;@4a8c2cfe, log id: 7857425 >2012-12-23 17:20:04,902 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (QuartzScheduler_Worker-72) [2cfd3156] Rerun vm c0c305a3-29c0-48be-b2bc-4ce78d82ac4c. Called from vds orchid-vds1 >2012-12-23 17:20:04,957 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-3) [2cfd3156] START, MigrateStatusVDSCommand(HostName = orchid-vds1, HostId = 1ea924d8-49a9-11e2-bbf4-001122334455, vmId=c0c305a3-29c0-48be-b2bc-4ce78d82ac4c), log id: 50ef1e4e >2012-12-23 17:20:04,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-3) [2cfd3156] Failed in MigrateStatusVDS method >2012-12-23 17:20:04,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-3) [2cfd3156] Error code migrateErr and error message VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:20:04,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-3) [2cfd3156] Command org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand return value > Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc >mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc >mCode 12 >mMessage Fatal error during migration > > >2012-12-23 17:20:04,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (pool-3-thread-3) [2cfd3156] HostName = orchid-vds1 >2012-12-23 17:20:04,976 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (pool-3-thread-3) [2cfd3156] Command MigrateStatusVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to MigrateStatusVDS, error = Fatal error during migration >2012-12-23 17:20:04,976 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] (pool-3-thread-3) [2cfd3156] FINISH, MigrateStatusVDSCommand, log id: 50ef1e4e >2012-12-23 17:20:05,042 INFO [org.ovirt.engine.core.bll.VdsSelector] (pool-3-thread-3) [2cfd3156] VDS orchid-vds2 2d10c76a-49a9-11e2-9ecf-001122334455 have failed running this VM in the current selection cycle >2012-12-23 17:20:05,042 WARN [org.ovirt.engine.core.bll.MigrateVmCommand] (pool-3-thread-3) [2cfd3156] CanDoAction of action MigrateVm failed. Reasons:ACTION_TYPE_FAILED_VDS_VM_CLUSTER,VAR__ACTION__MIGRATE,VAR__TYPE__VM >2012-12-23 17:22:53,429 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-8) [3c6916e] Running command: AddVmInterfaceCommand internal: false. Entities affected : ID: ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6 Type: VM >2012-12-23 17:22:53,538 WARN [org.ovirt.engine.core.bll.ActivateDeactivateVmNicCommand] (ajp-/127.0.0.1:8702-8) [4112e1fc] CanDoAction of action ActivateDeactivateVmNic failed. Reasons:VAR__ACTION__ACTIVATE,VAR__TYPE__INTERFACE,ACTIVATE_DEACTIVATE_NETWORK_NOT_IN_VDS >2012-12-23 17:22:53,547 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-8) [4112e1fc] Command [id=54f2bf0b-2ceb-43ce-a75f-ab028486d72d]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmDevice; snapshot: deviceId = 11d15dc1-4157-4949-9d5e-46e011381afa, vmId = ea91c5c9-c84b-4d06-9ca7-d971a56dc5d6. >2012-12-23 17:22:53,549 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-8) [4112e1fc] Command [id=54f2bf0b-2ceb-43ce-a75f-ab028486d72d]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkStatistics; snapshot: 11d15dc1-4157-4949-9d5e-46e011381afa. >2012-12-23 17:22:53,549 INFO [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-8) [4112e1fc] Command [id=54f2bf0b-2ceb-43ce-a75f-ab028486d72d]: Compensating NEW_ENTITY_ID of org.ovirt.engine.core.common.businessentities.VmNetworkInterface; snapshot: 11d15dc1-4157-4949-9d5e-46e011381afa. >2012-12-23 17:22:57,212 WARN [org.ovirt.engine.core.bll.AddVmInterfaceCommand] (ajp-/127.0.0.1:8702-12) [28b918a8] CanDoAction of action AddVmInterface failed. Reasons:VAR__ACTION__ADD,VAR__TYPE__INTERFACE,NETWORK_MAC_ADDRESS_IN_USE
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 889797
: 668063